Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4682 originally caused by: Started by upstream project "master-osmo-trx" build number 4891 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30089 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37257 originally caused by: Started by upstream project "master-osmo-iuh" build number 12873 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29305 originally caused by: Started by upstream project "master-osmo-msc" build number 34266 originally caused by: Started by upstream project "master-osmo-iuh" build number 12873 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8959 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2986 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29305 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30089 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4682 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9255 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins861605623015217428.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 13:00:57 + trial_dir_prefix=trial- + rm -rf trial-2389 trial-2389-bin.tgz trial-2389-run.tgz + trial_dir=trial-2390 + mkdir -p trial-2390 + mv open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9255.tgz osmo-trx.build-4682.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2390 + cat open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9255.md5 osmo-trx.build-4682.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9255.md5 osmo-trx.build-4682.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2390 combinations: None trial: 'trial-2390' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2390 -------------------------------------------------------------------------------------------- 13:01:08.775583 tst trial-2390: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/log --------------------------------------------------------------------- trial-2390 nitb_sms:sysmo --------------------------------------------------------------------- 13:03:16.773706 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:16.779174 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 13:03:16.803646 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 13:03:16.811926 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 13:03:16.867441 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 13:03:16.890213 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 13:03:16.898309 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 13:03:17.437328 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 13:03:17.442820 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 13:03:17.456009 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 13:03:17.837927 tst mo_mt_sms.py: using LAC 34125 13:03:18.083120 tst mo_mt_sms.py: using RAC 210 13:03:18.205376 tst mo_mt_sms.py: using CellId 34125 13:03:18.326654 tst mo_mt_sms.py: using BVCI 34126 13:03:18.441014 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 13:03:18.623581 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 13:03:18.742585 tst mo_mt_sms.py:9: start nitb and bts... 13:03:18.960721 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:03:21.316462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24074): Launched 13:03:21.644123 run osmo-nitb_10.42.42.2(pid=24075): Launched 13:03:21.822352 run osmo-nitb_10.42.42.2(pid=24075): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24075)] 13:03:21.955577 run osmo-nitb_10.42.42.2(pid=24075): stdout: | (launched: 2022-12-13_13:03:21.583516) 13:03:22.090800 run osmo-nitb_10.42.42.2(pid=24075): stderr: | (launched: 2022-12-13_13:03:21.632003) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:22.226731 run osmo-nitb_10.42.42.2(pid=24075): stdout: | (launched: 2022-12-13_13:03:21.583516) 13:03:22.355559 run osmo-nitb_10.42.42.2(pid=24075): stderr: | (launched: 2022-12-13_13:03:21.632003) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:22.510154 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24075): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24075) [trial-2390↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24075)] [trial-2390↪nitb_sms:sysmo↪mo_mt_sms.py:11] 13:03:22.519120 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 13:03:22.526166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24074): Terminating (SIGTERM) 13:03:22.737718 --- ParallelTerminationStrategy: PID 24074 died... 13:03:22.759756 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24074): Terminated: ok {rc=0} 13:03:22.849391 bus /sierra_3: Setting Powered False 13:03:23.951555 bus /sierra_3: Setting Powered False 13:03:25.069200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:sysmo --------------------------------------------------------------------- 13:03:26.251608 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:26.255927 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 13:03:26.277476 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 13:03:26.306787 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 13:03:26.362509 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 13:03:26.383273 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 13:03:26.409529 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 13:03:26.954860 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:sysmo mo_mt_sms.py ---------------------------------------------- 13:03:26.960218 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:26.970805 tst sms:sysmo: Using 1 x bts (candidates: 1) 13:03:27.011546 tst mo_mt_sms.py: using LAC 34126 13:03:27.130788 tst mo_mt_sms.py: using RAC 211 13:03:27.251734 tst mo_mt_sms.py: using CellId 34126 13:03:27.369749 tst mo_mt_sms.py: using BVCI 34127 13:03:27.480381 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:27.492827 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:27.504409 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:27.515290 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:27.527155 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 13:03:27.538901 tst sms:sysmo: Using 1 x modem (candidates: 2) 13:03:27.655951 tst sms:sysmo: Using 1 x modem (candidates: 2) 13:03:27.780446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:29.564878 run create_hlr_db(pid=24079): Launched 13:03:29.691566 bus /sierra_2: Setting Powered False 13:03:30.755777 run create_hlr_db(pid=24079): Terminated: ok {rc=0} 13:03:31.237717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24081): Launched 13:03:31.565318 run osmo-hlr_10.42.42.2(pid=24082): Launched 13:03:31.817511 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:34.495694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24084): Launched 13:03:34.823029 run osmo-stp_10.42.42.5(pid=24085): Launched 13:03:34.949327 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:40.438655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24087): Launched 13:03:40.764630 run osmo-msc_10.42.42.6(pid=24088): Launched 13:03:40.946472 run osmo-stp_10.42.42.5(pid=24085): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24085)] 13:03:41.083031 run osmo-stp_10.42.42.5(pid=24085): stdout: | (launched: 2022-12-13_13:03:34.762266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:41.222162 run osmo-stp_10.42.42.5(pid=24085): stderr: | 20221213130334956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130334956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130334956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130334957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130334957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130334957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130334957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:41.359060 run osmo-stp_10.42.42.5(pid=24085): stdout: | (launched: 2022-12-13_13:03:34.762266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:41.487652 run osmo-stp_10.42.42.5(pid=24085): stderr: | 20221213130334956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130334956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130334956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130334957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130334957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130334957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130334957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:41.641765 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24085): Process ended prematurely: osmo-stp_10.42.42.5(pid=24085) [trial-2390↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24085)] [trial-2390↪sms:sysmo↪mo_mt_sms.py:16] 13:03:41.650738 tst mo_mt_sms.py:16: Test FAILED (14.7 sec) 13:03:41.678129 run osmo-hlr_10.42.42.2(pid=24082): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24082)] 13:03:41.729071 run osmo-hlr_10.42.42.2(pid=24082): stdout: | (launched: 2022-12-13_13:03:31.501335) 13:03:41.781443 run osmo-hlr_10.42.42.2(pid=24082): stderr: | 20221213130331777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130331777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130331777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130331777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130331777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130331777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130331796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130331804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130331804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130331804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:41.854026 run osmo-msc_10.42.42.6(pid=24088): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24088)] 13:03:41.904218 run osmo-msc_10.42.42.6(pid=24088): stdout: | (launched: 2022-12-13_13:03:40.704525) 13:03:41.956464 run osmo-msc_10.42.42.6(pid=24088): stderr: | 20221213130341035 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130341035 DLGLOBAL DEBUG validating counter group 0x7f3985ab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130341035 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130341035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130341035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130341035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130341037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130341037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130341038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130341038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:42.009249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24081): Terminating (SIGTERM) 13:03:42.051036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24084): Terminating (SIGTERM) 13:03:42.093506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24087): Terminating (SIGTERM) 13:03:42.136821 --- ParallelTerminationStrategy: PID 24081 died... 13:03:42.157582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24081): Terminated: ok {rc=0} 13:03:42.204716 --- ParallelTerminationStrategy: PID 24084 died... 13:03:42.224775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24084): Terminated: ok {rc=0} 13:03:42.271679 --- ParallelTerminationStrategy: PID 24087 died... 13:03:42.291771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24087): Terminated: ok {rc=0} 13:03:42.381113 bus /sierra_3: Setting Powered False 13:03:43.481066 bus /sierra_3: Setting Powered False 13:03:44.598031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:sysmo --------------------------------------------------------------------- 13:03:45.816586 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:45.820228 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 13:03:45.861183 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 13:03:45.868778 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 13:03:45.908679 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 13:03:45.937316 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 13:03:45.944560 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 13:03:46.463539 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 13:03:46.472170 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 13:03:46.488511 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 13:03:46.536612 tst assert_extension.py: using LAC 34127 13:03:46.670518 tst assert_extension.py: using RAC 212 13:03:46.802602 tst assert_extension.py: using CellId 34127 13:03:46.930216 tst assert_extension.py: using BVCI 34128 13:03:47.084922 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 13:03:47.203274 tst assert_extension.py:10: start nitb and bts... 13:03:47.409480 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:03:48.033937 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24093): Launched 13:03:48.340278 run osmo-nitb_10.42.42.2(pid=24094): Launched 13:03:48.507689 run osmo-nitb_10.42.42.2(pid=24094): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24094)] 13:03:48.643690 run osmo-nitb_10.42.42.2(pid=24094): stdout: | (launched: 2022-12-13_13:03:48.283260) 13:03:48.780897 run osmo-nitb_10.42.42.2(pid=24094): stderr: | (launched: 2022-12-13_13:03:48.328380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:48.917706 run osmo-nitb_10.42.42.2(pid=24094): stdout: | (launched: 2022-12-13_13:03:48.283260) 13:03:49.049318 run osmo-nitb_10.42.42.2(pid=24094): stderr: | (launched: 2022-12-13_13:03:48.328380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24094) [trial-2390↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24094)] 13:03:49.454094 tst osmo-nitb_10.42.42.2(pid=24094): stdout: | (launched: 2022-12-13_13:03:48.283260) 13:03:49.575550 tst osmo-nitb_10.42.42.2(pid=24094): stderr: | (launched: 2022-12-13_13:03:48.328380) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:49.719585 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24094) [trial-2390↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24094)] [trial-2390↪nitb_ussd:sysmo↪assert_extension.py:12] 13:03:49.728194 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:03:49.735062 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24093): Terminating (SIGTERM) 13:03:49.943804 --- ParallelTerminationStrategy: PID 24093 died... 13:03:49.964540 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24093): Terminated: ok {rc=0} 13:03:50.049392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:sysmo --------------------------------------------------------------------- 13:03:51.228708 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:51.232506 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 13:03:51.253301 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 13:03:51.279966 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 13:03:51.314041 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 13:03:51.334846 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 13:03:51.361378 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 13:03:51.891524 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:sysmo assert_extension.py ---------------------------------------------- 13:03:51.896770 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:51.907507 tst ussd:sysmo: Using 1 x bts (candidates: 1) 13:03:51.942350 tst assert_extension.py: using LAC 34128 13:03:52.060123 tst assert_extension.py: using RAC 213 13:03:52.177853 tst assert_extension.py: using CellId 34128 13:03:52.293785 tst assert_extension.py: using BVCI 34129 13:03:52.402990 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:52.413631 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:52.424158 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:52.434557 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:52.444936 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 13:03:52.455377 tst ussd:sysmo: Using 1 x modem (candidates: 1) 13:03:52.575630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:53.081278 run create_hlr_db(pid=24100): Launched 13:03:53.207681 bus /sierra_2: Setting Powered False 13:03:54.272327 run create_hlr_db(pid=24100): Terminated: ok {rc=0} 13:03:54.708688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24102): Launched 13:03:55.015781 run osmo-hlr_10.42.42.2(pid=24103): Launched 13:03:55.133362 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:55.660865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24105): Launched 13:03:55.967822 run osmo-stp_10.42.42.5(pid=24106): Launched 13:03:56.083260 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:56.632380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24108): Launched 13:03:56.938704 run osmo-msc_10.42.42.6(pid=24109): Launched 13:03:57.110097 run osmo-stp_10.42.42.5(pid=24106): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24106)] 13:03:57.240768 run osmo-stp_10.42.42.5(pid=24106): stdout: | (launched: 2022-12-13_13:03:55.910572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:57.370322 run osmo-stp_10.42.42.5(pid=24106): stderr: | 20221213130356082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130356082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130356082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130356083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130356085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130356085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130356085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:57.497824 run osmo-stp_10.42.42.5(pid=24106): stdout: | (launched: 2022-12-13_13:03:55.910572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:57.619664 run osmo-stp_10.42.42.5(pid=24106): stderr: | 20221213130356082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130356082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130356082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130356083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130356085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130356085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130356085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:57.765278 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24106): Process ended prematurely: osmo-stp_10.42.42.5(pid=24106) [trial-2390↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24106)] [trial-2390↪ussd:sysmo↪assert_extension.py:17] 13:03:57.773829 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:03:57.799822 run osmo-hlr_10.42.42.2(pid=24103): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24103)] 13:03:57.848048 run osmo-hlr_10.42.42.2(pid=24103): stdout: | (launched: 2022-12-13_13:03:54.958493) 13:03:57.898097 run osmo-hlr_10.42.42.2(pid=24103): stderr: | 20221213130355136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130355136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130355136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130355136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130355136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130355136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130355153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130355162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130355162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130355163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:57.967464 run osmo-msc_10.42.42.6(pid=24109): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24109)] 13:03:58.016091 run osmo-msc_10.42.42.6(pid=24109): stdout: | (launched: 2022-12-13_13:03:56.880936) 13:03:58.065874 run osmo-msc_10.42.42.6(pid=24109): stderr: | 20221213130357156 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130357156 DLGLOBAL DEBUG validating counter group 0x7efeea592c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130357156 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130357156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130357156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130357157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130357158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130357159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130357159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130357159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:58.116074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24102): Terminating (SIGTERM) 13:03:58.156653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24105): Terminating (SIGTERM) 13:03:58.196934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24108): Terminating (SIGTERM) 13:03:58.237377 --- ParallelTerminationStrategy: PID 24102 died... 13:03:58.256683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24102): Terminated: ok {rc=0} 13:03:58.301179 --- ParallelTerminationStrategy: PID 24105 died... 13:03:58.320026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24105): Terminated: ok {rc=0} 13:03:58.364161 --- ParallelTerminationStrategy: PID 24108 died... 13:03:58.382813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24108): Terminated: ok {rc=0} 13:03:58.466775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:03:59.658035 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:59.664311 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:03:59.684942 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:03:59.713007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:03:59.764862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:03:59.785985 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:03:59.812821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:04:00.364239 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:04:00.416305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:00.427364 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:00.484183 tst mo_mt_call.py: using LAC 34129 13:04:00.608509 tst mo_mt_call.py: using RAC 214 13:04:00.732673 tst mo_mt_call.py: using CellId 34129 13:04:00.872241 tst mo_mt_call.py: using BVCI 34130 13:04:01.002140 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:01.014815 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:01.027279 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:01.041512 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:01.055098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:01.069389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:01.198341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:01.345814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:01.954082 run create_hlr_db(pid=24115): Launched 13:04:02.102417 bus /sierra_2: Setting Powered False 13:04:03.167670 run create_hlr_db(pid=24115): Terminated: ok {rc=0} 13:04:03.612175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24117): Launched 13:04:03.925261 run osmo-hlr_10.42.42.2(pid=24118): Launched 13:04:04.044233 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:04.581226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24120): Launched 13:04:04.891949 run osmo-stp_10.42.42.5(pid=24121): Launched 13:04:05.012145 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:05.573351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24123): Launched 13:04:05.887106 run osmo-msc_10.42.42.6(pid=24124): Launched 13:04:06.060648 run osmo-stp_10.42.42.5(pid=24121): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24121)] 13:04:06.190888 run osmo-stp_10.42.42.5(pid=24121): stdout: | (launched: 2022-12-13_13:04:04.833648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:06.321499 run osmo-stp_10.42.42.5(pid=24121): stderr: | 20221213130405006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130405006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130405006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130405007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130405009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130405009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130405009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:06.450182 run osmo-stp_10.42.42.5(pid=24121): stdout: | (launched: 2022-12-13_13:04:04.833648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:06.572236 run osmo-stp_10.42.42.5(pid=24121): stderr: | 20221213130405006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130405006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130405006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130405007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130405009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130405009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130405009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:06.722329 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24121): Process ended prematurely: osmo-stp_10.42.42.5(pid=24121) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24121)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:04:06.733392 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:04:06.765591 run osmo-hlr_10.42.42.2(pid=24118): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24118)] 13:04:06.821961 run osmo-hlr_10.42.42.2(pid=24118): stdout: | (launched: 2022-12-13_13:04:03.866997) 13:04:06.881935 run osmo-hlr_10.42.42.2(pid=24118): stderr: | 20221213130404049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130404049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130404049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130404049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130404049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130404049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130404103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130404112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130404112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130404112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:06.957850 run osmo-msc_10.42.42.6(pid=24124): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24124)] 13:04:07.005515 run osmo-msc_10.42.42.6(pid=24124): stdout: | (launched: 2022-12-13_13:04:05.828112) 13:04:07.054672 run osmo-msc_10.42.42.6(pid=24124): stderr: | 20221213130406102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130406103 DLGLOBAL DEBUG validating counter group 0x7f7aebd73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130406103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130406103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130406103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130406103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130406105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130406105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130406105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130406106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:07.104191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24117): Terminating (SIGTERM) 13:04:07.143771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24120): Terminating (SIGTERM) 13:04:07.183493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24123): Terminating (SIGTERM) 13:04:07.223489 --- ParallelTerminationStrategy: PID 24117 died... 13:04:07.242458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24117): Terminated: ok {rc=0} 13:04:07.286281 --- ParallelTerminationStrategy: PID 24120 died... 13:04:07.304776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24120): Terminated: ok {rc=0} 13:04:07.349569 --- ParallelTerminationStrategy: PID 24123 died... 13:04:07.368136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24123): Terminated: ok {rc=0} 13:04:07.454304 bus /sierra_3: Setting Powered False 13:04:08.555197 bus /sierra_3: Setting Powered False 13:04:09.671315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:04:10.822694 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:10.835203 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:10.941474 tst mo_mt_call_osmux.py: using LAC 34130 13:04:11.072654 tst mo_mt_call_osmux.py: using RAC 215 13:04:11.202497 tst mo_mt_call_osmux.py: using CellId 34130 13:04:11.332753 tst mo_mt_call_osmux.py: using BVCI 34131 13:04:11.447819 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:11.458962 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:11.469964 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:11.480808 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:11.491766 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:11.502760 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:11.624447 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:11.744093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:12.268081 run create_hlr_db(pid=24126): Launched 13:04:12.408850 bus /sierra_2: Setting Powered False 13:04:13.470485 run create_hlr_db(pid=24126): Terminated: ok {rc=0} 13:04:13.924513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24128): Launched 13:04:14.260040 run osmo-hlr_10.42.42.2(pid=24129): Launched 13:04:14.388922 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:14.960233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24131): Launched 13:04:15.295491 run osmo-stp_10.42.42.5(pid=24132): Launched 13:04:15.423616 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:16.068681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24134): Launched 13:04:16.413673 run osmo-msc_10.42.42.6(pid=24135): Launched 13:04:16.982198 run osmo-stp_10.42.42.5(pid=24132): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24132)] 13:04:17.323638 run osmo-stp_10.42.42.5(pid=24132): stdout: | (launched: 2022-12-13_13:04:15.233512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:17.465745 run osmo-stp_10.42.42.5(pid=24132): stderr: | 20221213130415429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130415430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130415430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130415430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130415433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130415433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130415433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:17.604942 run osmo-stp_10.42.42.5(pid=24132): stdout: | (launched: 2022-12-13_13:04:15.233512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:17.737244 run osmo-stp_10.42.42.5(pid=24132): stderr: | 20221213130415429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130415430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130415430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130415430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130415433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130415433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130415433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:17.895231 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24132): Process ended prematurely: osmo-stp_10.42.42.5(pid=24132) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24132)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:04:17.905020 tst mo_mt_call_osmux.py:8: Test FAILED (7.1 sec) 13:04:17.932833 run osmo-hlr_10.42.42.2(pid=24129): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24129)] 13:04:17.985767 run osmo-hlr_10.42.42.2(pid=24129): stdout: | (launched: 2022-12-13_13:04:14.198439) 13:04:18.039181 run osmo-hlr_10.42.42.2(pid=24129): stderr: | 20221213130414400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130414400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130414400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130414400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130414400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130414400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130414449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130414459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130414460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130414460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:18.113035 run osmo-msc_10.42.42.6(pid=24135): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24135)] 13:04:18.165034 run osmo-msc_10.42.42.6(pid=24135): stdout: | (launched: 2022-12-13_13:04:16.353579) 13:04:18.218601 run osmo-msc_10.42.42.6(pid=24135): stderr: | 20221213130416847 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130416847 DLGLOBAL DEBUG validating counter group 0x7fc993ce9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130416847 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130416848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130416848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130416848 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130416852 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130416854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130416854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130416855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:18.272722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24128): Terminating (SIGTERM) 13:04:18.314976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24131): Terminating (SIGTERM) 13:04:18.358299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24134): Terminating (SIGTERM) 13:04:18.401474 --- ParallelTerminationStrategy: PID 24128 died... 13:04:18.422188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24128): Terminated: ok {rc=0} 13:04:18.469679 --- ParallelTerminationStrategy: PID 24131 died... 13:04:18.490297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24131): Terminated: ok {rc=0} 13:04:18.537658 --- ParallelTerminationStrategy: PID 24134 died... 13:04:18.558058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24134): Terminated: ok {rc=0} 13:04:18.648168 bus /sierra_3: Setting Powered False 13:04:19.747153 bus /sierra_3: Setting Powered False 13:04:20.863255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:04:22.106367 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:22.114543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:04:22.135890 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:04:22.164163 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:04:22.216839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:04:22.238359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:04:22.266018 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:04:22.827357 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:04:22.881872 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:22.893563 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:04:22.951338 tst mo_mt_call.py: using LAC 34131 13:04:23.073482 tst mo_mt_call.py: using RAC 216 13:04:23.195873 tst mo_mt_call.py: using CellId 34131 13:04:23.316776 tst mo_mt_call.py: using BVCI 34132 13:04:23.430133 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:23.441652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:23.452582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:23.463548 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:23.474542 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:23.485505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:23.608092 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:23.728669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:24.247429 run create_hlr_db(pid=24140): Launched 13:04:24.376314 bus /sierra_2: Setting Powered False 13:04:25.441570 run create_hlr_db(pid=24140): Terminated: ok {rc=0} 13:04:25.903863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24142): Launched 13:04:26.239233 run osmo-hlr_10.42.42.2(pid=24143): Launched 13:04:26.367759 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:26.943958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24145): Launched 13:04:27.279373 run osmo-stp_10.42.42.5(pid=24146): Launched 13:04:27.408094 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:28.008408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24148): Launched 13:04:28.344276 run osmo-msc_10.42.42.6(pid=24149): Launched 13:04:28.530513 run osmo-stp_10.42.42.5(pid=24146): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24146)] 13:04:28.670799 run osmo-stp_10.42.42.5(pid=24146): stdout: | (launched: 2022-12-13_13:04:27.217423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:28.811622 run osmo-stp_10.42.42.5(pid=24146): stderr: | 20221213130427413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130427413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130427414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130427414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130427414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130427415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130427415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:28.950855 run osmo-stp_10.42.42.5(pid=24146): stdout: | (launched: 2022-12-13_13:04:27.217423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:29.082681 run osmo-stp_10.42.42.5(pid=24146): stderr: | 20221213130427413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130427413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130427414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130427414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130427414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130427415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130427415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:29.240837 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24146): Process ended prematurely: osmo-stp_10.42.42.5(pid=24146) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24146)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:04:29.250557 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:04:29.278636 run osmo-hlr_10.42.42.2(pid=24143): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24143)] 13:04:29.330868 run osmo-hlr_10.42.42.2(pid=24143): stdout: | (launched: 2022-12-13_13:04:26.177276) 13:04:29.383231 run osmo-hlr_10.42.42.2(pid=24143): stderr: | 20221213130426379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130426379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130426379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130426379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130426379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130426379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130426391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130426400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130426400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130426400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:29.455962 run osmo-msc_10.42.42.6(pid=24149): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24149)] 13:04:29.506750 run osmo-msc_10.42.42.6(pid=24149): stdout: | (launched: 2022-12-13_13:04:28.282134) 13:04:29.559254 run osmo-msc_10.42.42.6(pid=24149): stderr: | 20221213130428610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130428610 DLGLOBAL DEBUG validating counter group 0x7fc08b70dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130428610 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130428610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130428610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130428610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130428612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130428612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130428612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130428612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:29.611930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24142): Terminating (SIGTERM) 13:04:29.653810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24145): Terminating (SIGTERM) 13:04:29.696115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24148): Terminating (SIGTERM) 13:04:29.738678 --- ParallelTerminationStrategy: PID 24142 died... 13:04:29.759126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24142): Terminated: ok {rc=0} 13:04:29.805770 --- ParallelTerminationStrategy: PID 24145 died... 13:04:29.825670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24145): Terminated: ok {rc=0} 13:04:29.871922 --- ParallelTerminationStrategy: PID 24148 died... 13:04:29.891928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24148): Terminated: ok {rc=0} 13:04:29.981400 bus /sierra_3: Setting Powered False 13:04:31.076726 bus /sierra_3: Setting Powered False 13:04:32.213035 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:04:33.367049 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:33.379286 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:04:33.438721 tst mo_mt_call_osmux.py: using LAC 34132 13:04:33.570352 tst mo_mt_call_osmux.py: using RAC 217 13:04:33.700698 tst mo_mt_call_osmux.py: using CellId 34132 13:04:33.832428 tst mo_mt_call_osmux.py: using BVCI 34133 13:04:33.955141 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:33.966781 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:33.978194 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:33.989734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:34.001462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:34.013278 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:34.132562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:34.250086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:34.736112 run create_hlr_db(pid=24151): Launched 13:04:34.866262 bus /sierra_2: Setting Powered False 13:04:35.928008 run create_hlr_db(pid=24151): Terminated: ok {rc=0} 13:04:36.382894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24153): Launched 13:04:36.718007 run osmo-hlr_10.42.42.2(pid=24154): Launched 13:04:36.845225 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:37.422045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24156): Launched 13:04:37.756079 run osmo-stp_10.42.42.5(pid=24157): Launched 13:04:37.884082 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:38.486395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24159): Launched 13:04:38.820129 run osmo-msc_10.42.42.6(pid=24160): Launched 13:04:39.006700 run osmo-stp_10.42.42.5(pid=24157): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24157)] 13:04:39.147201 run osmo-stp_10.42.42.5(pid=24157): stdout: | (launched: 2022-12-13_13:04:37.693803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:39.288602 run osmo-stp_10.42.42.5(pid=24157): stderr: | 20221213130437891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130437891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130437891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130437891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130437894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130437894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130437894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:39.427849 run osmo-stp_10.42.42.5(pid=24157): stdout: | (launched: 2022-12-13_13:04:37.693803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:39.559732 run osmo-stp_10.42.42.5(pid=24157): stderr: | 20221213130437891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130437891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130437891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130437891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130437894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130437894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130437894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:39.718161 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24157): Process ended prematurely: osmo-stp_10.42.42.5(pid=24157) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24157)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:04:39.727970 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:04:39.756071 run osmo-hlr_10.42.42.2(pid=24154): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24154)] 13:04:39.807935 run osmo-hlr_10.42.42.2(pid=24154): stdout: | (launched: 2022-12-13_13:04:36.655674) 13:04:39.860359 run osmo-hlr_10.42.42.2(pid=24154): stderr: | 20221213130436861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130436861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130436861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130436861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130436861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130436861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130436876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130436886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130436886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130436886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:39.933510 run osmo-msc_10.42.42.6(pid=24160): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24160)] 13:04:39.984002 run osmo-msc_10.42.42.6(pid=24160): stdout: | (launched: 2022-12-13_13:04:38.758167) 13:04:40.036844 run osmo-msc_10.42.42.6(pid=24160): stderr: | 20221213130439084 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130439084 DLGLOBAL DEBUG validating counter group 0x7fdaa974cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130439084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130439084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130439084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130439084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130439086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130439086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130439087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130439087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:40.089798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24153): Terminating (SIGTERM) 13:04:40.131815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24156): Terminating (SIGTERM) 13:04:40.174728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24159): Terminating (SIGTERM) 13:04:40.217753 --- ParallelTerminationStrategy: PID 24153 died... 13:04:40.238289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24153): Terminated: ok {rc=0} 13:04:40.285442 --- ParallelTerminationStrategy: PID 24156 died... 13:04:40.305669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24156): Terminated: ok {rc=0} 13:04:40.352538 --- ParallelTerminationStrategy: PID 24159 died... 13:04:40.372709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24159): Terminated: ok {rc=0} 13:04:40.461745 bus /sierra_3: Setting Powered False 13:04:41.562979 bus /sierra_3: Setting Powered False 13:04:42.679766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:04:43.917767 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:43.924641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:04:43.946182 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:04:43.974795 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:04:44.029330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:04:44.050645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:04:44.078337 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:04:44.627093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:04:44.677093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:44.688241 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:04:44.745087 tst mo_mt_call.py: using LAC 34133 13:04:44.869813 tst mo_mt_call.py: using RAC 218 13:04:44.993470 tst mo_mt_call.py: using CellId 34133 13:04:45.117624 tst mo_mt_call.py: using BVCI 34134 13:04:45.241296 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:45.253172 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:45.264740 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:45.276358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:45.288297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:45.300435 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:45.418876 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:45.540711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:46.063908 run create_hlr_db(pid=24165): Launched 13:04:46.222545 bus /sierra_2: Setting Powered False 13:04:47.286783 run create_hlr_db(pid=24165): Terminated: ok {rc=0} 13:04:47.734177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Launched 13:04:48.048469 run osmo-hlr_10.42.42.2(pid=24168): Launched 13:04:48.166112 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:48.717918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Launched 13:04:49.029727 run osmo-stp_10.42.42.5(pid=24171): Launched 13:04:49.150831 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:49.717561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24173): Launched 13:04:50.033441 run osmo-msc_10.42.42.6(pid=24174): Launched 13:04:50.208337 run osmo-stp_10.42.42.5(pid=24171): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] 13:04:50.340796 run osmo-stp_10.42.42.5(pid=24171): stdout: | (launched: 2022-12-13_13:04:48.971419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:50.473772 run osmo-stp_10.42.42.5(pid=24171): stderr: | 20221213130449146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130449146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130449146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130449147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130449147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130449147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130449147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:50.604320 run osmo-stp_10.42.42.5(pid=24171): stdout: | (launched: 2022-12-13_13:04:48.971419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:50.728568 run osmo-stp_10.42.42.5(pid=24171): stderr: | 20221213130449146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130449146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130449146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130449147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130449147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130449147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130449147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:50.877252 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24171): Process ended prematurely: osmo-stp_10.42.42.5(pid=24171) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:04:50.886101 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:04:50.912403 run osmo-hlr_10.42.42.2(pid=24168): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24168)] 13:04:50.960675 run osmo-hlr_10.42.42.2(pid=24168): stdout: | (launched: 2022-12-13_13:04:47.990084) 13:04:51.010374 run osmo-hlr_10.42.42.2(pid=24168): stderr: | 20221213130448172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130448172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130448172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130448172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130448172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130448172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130448186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130448195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130448195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130448195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:51.079594 run osmo-msc_10.42.42.6(pid=24174): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24174)] 13:04:51.127871 run osmo-msc_10.42.42.6(pid=24174): stdout: | (launched: 2022-12-13_13:04:49.974029) 13:04:51.177492 run osmo-msc_10.42.42.6(pid=24174): stderr: | 20221213130450251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130450251 DLGLOBAL DEBUG validating counter group 0x7f3c765a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130450251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130450251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130450251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130450252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130450253 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130450254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130450254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130450254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:51.227255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Terminating (SIGTERM) 13:04:51.267027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Terminating (SIGTERM) 13:04:51.306611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24173): Terminating (SIGTERM) 13:04:51.346396 --- ParallelTerminationStrategy: PID 24167 died... 13:04:51.365483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Terminated: ok {rc=0} 13:04:51.409400 --- ParallelTerminationStrategy: PID 24170 died... 13:04:51.427819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Terminated: ok {rc=0} 13:04:51.471537 --- ParallelTerminationStrategy: PID 24173 died... 13:04:51.490091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24173): Terminated: ok {rc=0} 13:04:51.575200 bus /sierra_3: Setting Powered False 13:04:52.675177 bus /sierra_3: Setting Powered False 13:04:53.789714 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:04:54.938009 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:54.949847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:04:55.006797 tst mo_mt_call_osmux.py: using LAC 34134 13:04:55.131503 tst mo_mt_call_osmux.py: using RAC 219 13:04:55.255337 tst mo_mt_call_osmux.py: using CellId 34134 13:04:55.388941 tst mo_mt_call_osmux.py: using BVCI 34135 13:04:55.510919 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:55.522621 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:55.534359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:55.546016 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:55.558077 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:55.569853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:55.688067 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:55.811948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:56.329552 run create_hlr_db(pid=24176): Launched 13:04:56.457174 bus /sierra_2: Setting Powered False 13:04:57.522799 run create_hlr_db(pid=24176): Terminated: ok {rc=0} 13:04:57.985317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24178): Launched 13:04:58.320762 run osmo-hlr_10.42.42.2(pid=24179): Launched 13:04:58.448026 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:59.020631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24181): Launched 13:04:59.356418 run osmo-stp_10.42.42.5(pid=24182): Launched 13:04:59.483733 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:00.087432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24184): Launched 13:05:00.423192 run osmo-msc_10.42.42.6(pid=24185): Launched 13:05:00.608772 run osmo-stp_10.42.42.5(pid=24182): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24182)] 13:05:00.748440 run osmo-stp_10.42.42.5(pid=24182): stdout: | (launched: 2022-12-13_13:04:59.293328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:00.906723 run osmo-stp_10.42.42.5(pid=24182): stderr: | 20221213130459487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130459487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130459487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130459488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130459490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130459490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130459491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:01.096536 run osmo-stp_10.42.42.5(pid=24182): stdout: | (launched: 2022-12-13_13:04:59.293328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:01.231934 run osmo-stp_10.42.42.5(pid=24182): stderr: | 20221213130459487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130459487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130459487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130459488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130459490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130459490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130459491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:01.404450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24182): Process ended prematurely: osmo-stp_10.42.42.5(pid=24182) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24182)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:05:01.415383 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:05:01.444100 run osmo-hlr_10.42.42.2(pid=24179): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24179)] 13:05:01.497066 run osmo-hlr_10.42.42.2(pid=24179): stdout: | (launched: 2022-12-13_13:04:58.258330) 13:05:01.550652 run osmo-hlr_10.42.42.2(pid=24179): stderr: | 20221213130458460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130458460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130458460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130458460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130458461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130458461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130458471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130458480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130458480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130458480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:01.624666 run osmo-msc_10.42.42.6(pid=24185): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24185)] 13:05:01.676928 run osmo-msc_10.42.42.6(pid=24185): stdout: | (launched: 2022-12-13_13:05:00.360141) 13:05:01.730855 run osmo-msc_10.42.42.6(pid=24185): stderr: | 20221213130500686 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130500686 DLGLOBAL DEBUG validating counter group 0x7fcb81196c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130500687 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130500687 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130500687 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130500687 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130500689 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130500689 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130500689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130500689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:01.785559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24178): Terminating (SIGTERM) 13:05:01.829205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24181): Terminating (SIGTERM) 13:05:01.874023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24184): Terminating (SIGTERM) 13:05:01.920584 --- ParallelTerminationStrategy: PID 24178 died... 13:05:01.942369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24178): Terminated: ok {rc=0} 13:05:01.990597 --- ParallelTerminationStrategy: PID 24181 died... 13:05:02.012017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24181): Terminated: ok {rc=0} 13:05:02.060285 --- ParallelTerminationStrategy: PID 24184 died... 13:05:02.081604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24184): Terminated: ok {rc=0} 13:05:02.181263 bus /sierra_3: Setting Powered False 13:05:03.280343 bus /sierra_3: Setting Powered False 13:05:04.397133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:05:05.640294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:05.646586 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:05:05.667159 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:05:05.693653 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:05:05.743350 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:05:05.764550 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:05:05.792484 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:05:06.343725 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:05:06.394348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:06.405588 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:06.460545 tst mo_mt_call.py: using LAC 34135 13:05:06.582927 tst mo_mt_call.py: using RAC 220 13:05:06.705453 tst mo_mt_call.py: using CellId 34135 13:05:06.836837 tst mo_mt_call.py: using BVCI 34136 13:05:06.959046 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:06.970874 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:06.982604 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:06.994025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:07.005934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:07.017736 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:07.135603 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:07.257451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:07.774928 run create_hlr_db(pid=24194): Launched 13:05:07.902670 bus /sierra_2: Setting Powered False 13:05:08.967421 run create_hlr_db(pid=24194): Terminated: ok {rc=0} 13:05:09.413657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24196): Launched 13:05:09.727207 run osmo-hlr_10.42.42.2(pid=24197): Launched 13:05:09.846537 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:10.383722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24199): Launched 13:05:10.696886 run osmo-stp_10.42.42.5(pid=24200): Launched 13:05:10.815230 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:11.377937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24202): Launched 13:05:11.690635 run osmo-msc_10.42.42.6(pid=24203): Launched 13:05:11.872015 run osmo-stp_10.42.42.5(pid=24200): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24200)] 13:05:12.004172 run osmo-stp_10.42.42.5(pid=24200): stdout: | (launched: 2022-12-13_13:05:10.637805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:12.135664 run osmo-stp_10.42.42.5(pid=24200): stderr: | 20221213130510816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130510816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130510816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130510816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130510817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130510817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130510817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:12.265724 run osmo-stp_10.42.42.5(pid=24200): stdout: | (launched: 2022-12-13_13:05:10.637805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:12.389514 run osmo-stp_10.42.42.5(pid=24200): stderr: | 20221213130510816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130510816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130510816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130510816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130510817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130510817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130510817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:12.538157 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24200): Process ended prematurely: osmo-stp_10.42.42.5(pid=24200) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24200)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:05:12.547171 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:05:12.573133 run osmo-hlr_10.42.42.2(pid=24197): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24197)] 13:05:12.620370 run osmo-hlr_10.42.42.2(pid=24197): stdout: | (launched: 2022-12-13_13:05:09.668022) 13:05:12.669579 run osmo-hlr_10.42.42.2(pid=24197): stderr: | 20221213130509849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130509849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130509849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130509850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130509850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130509850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130509916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130509925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130509925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130509925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:12.737597 run osmo-msc_10.42.42.6(pid=24203): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24203)] 13:05:12.784656 run osmo-msc_10.42.42.6(pid=24203): stdout: | (launched: 2022-12-13_13:05:11.631279) 13:05:12.833365 run osmo-msc_10.42.42.6(pid=24203): stderr: | 20221213130511909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130511909 DLGLOBAL DEBUG validating counter group 0x7fe346771c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130511909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130511909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130511909 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130511910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130511911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130511912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130511912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130511912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:12.882864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24196): Terminating (SIGTERM) 13:05:12.922308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24199): Terminating (SIGTERM) 13:05:12.961531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24202): Terminating (SIGTERM) 13:05:13.001221 --- ParallelTerminationStrategy: PID 24196 died... 13:05:13.020234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24196): Terminated: ok {rc=0} 13:05:13.063902 --- ParallelTerminationStrategy: PID 24199 died... 13:05:13.082527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24199): Terminated: ok {rc=0} 13:05:13.126280 --- ParallelTerminationStrategy: PID 24202 died... 13:05:13.144893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24202): Terminated: ok {rc=0} 13:05:13.231267 bus /sierra_3: Setting Powered False 13:05:14.329716 bus /sierra_3: Setting Powered False 13:05:15.442901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:05:16.615105 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:16.632573 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:16.706299 tst mo_mt_call_osmux.py: using LAC 34136 13:05:16.842923 tst mo_mt_call_osmux.py: using RAC 221 13:05:16.968826 tst mo_mt_call_osmux.py: using CellId 34136 13:05:17.092901 tst mo_mt_call_osmux.py: using BVCI 34137 13:05:17.233797 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:17.246633 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:17.259172 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:17.271879 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:17.285014 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:17.298165 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:17.422972 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:17.541256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:18.028563 run create_hlr_db(pid=24205): Launched 13:05:18.155946 bus /sierra_2: Setting Powered False 13:05:19.217856 run create_hlr_db(pid=24205): Terminated: ok {rc=0} 13:05:19.672664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Launched 13:05:20.008047 run osmo-hlr_10.42.42.2(pid=24208): Launched 13:05:20.137529 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:20.715464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Launched 13:05:21.049480 run osmo-stp_10.42.42.5(pid=24211): Launched 13:05:21.176610 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:21.781413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Launched 13:05:22.118910 run osmo-msc_10.42.42.6(pid=24214): Launched 13:05:22.305447 run osmo-stp_10.42.42.5(pid=24211): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] 13:05:22.450036 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-13_13:05:20.987071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:22.586545 run osmo-stp_10.42.42.5(pid=24211): stderr: | 20221213130521182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130521182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130521182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130521183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130521183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130521183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130521183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:22.725403 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-13_13:05:20.987071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:22.857447 run osmo-stp_10.42.42.5(pid=24211): stderr: | 20221213130521182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130521182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130521182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130521183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130521183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130521183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130521183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:23.015591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:05:23.025607 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:05:23.053538 run osmo-hlr_10.42.42.2(pid=24208): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24208)] 13:05:23.104495 run osmo-hlr_10.42.42.2(pid=24208): stdout: | (launched: 2022-12-13_13:05:19.945562) 13:05:23.157361 run osmo-hlr_10.42.42.2(pid=24208): stderr: | 20221213130520146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130520146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130520146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130520146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130520146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130520146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130520159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130520169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130520169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130520169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:23.230674 run osmo-msc_10.42.42.6(pid=24214): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24214)] 13:05:23.281128 run osmo-msc_10.42.42.6(pid=24214): stdout: | (launched: 2022-12-13_13:05:22.055789) 13:05:23.333645 run osmo-msc_10.42.42.6(pid=24214): stderr: | 20221213130522403 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130522403 DLGLOBAL DEBUG validating counter group 0x7f870eccfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130522403 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130522403 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130522403 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130522403 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130522405 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130522406 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130522406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130522406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:23.386328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminating (SIGTERM) 13:05:23.428007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminating (SIGTERM) 13:05:23.470223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Terminating (SIGTERM) 13:05:23.512283 --- ParallelTerminationStrategy: PID 24207 died... 13:05:23.532881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminated: ok {rc=0} 13:05:23.579823 --- ParallelTerminationStrategy: PID 24210 died... 13:05:23.599815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminated: ok {rc=0} 13:05:23.646220 --- ParallelTerminationStrategy: PID 24213 died... 13:05:23.666187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24213): Terminated: ok {rc=0} 13:05:23.754890 bus /sierra_3: Setting Powered False 13:05:24.854436 bus /sierra_3: Setting Powered False 13:05:25.972772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:05:27.210610 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:27.217853 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:05:27.239502 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:05:27.268252 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:05:27.322178 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:05:27.343512 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:05:27.371417 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:05:27.926899 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:05:27.980149 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:27.991743 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:05:28.047726 tst mo_mt_call.py: using LAC 34137 13:05:28.181230 tst mo_mt_call.py: using RAC 222 13:05:28.311152 tst mo_mt_call.py: using CellId 34137 13:05:28.439418 tst mo_mt_call.py: using BVCI 34138 13:05:28.562516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:28.574109 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:28.585547 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:28.596890 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:28.608698 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:28.620499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:28.738807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:28.860511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:29.380354 run create_hlr_db(pid=24219): Launched 13:05:29.507025 bus /sierra_2: Setting Powered False 13:05:30.572387 run create_hlr_db(pid=24219): Terminated: ok {rc=0} 13:05:31.060490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24221): Launched 13:05:31.454688 run osmo-hlr_10.42.42.2(pid=24222): Launched 13:05:31.802427 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:32.483035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24224): Launched 13:05:32.818696 run osmo-stp_10.42.42.5(pid=24225): Launched 13:05:32.946389 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:33.550217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24227): Launched 13:05:33.885592 run osmo-msc_10.42.42.6(pid=24228): Launched 13:05:34.071412 run osmo-stp_10.42.42.5(pid=24225): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24225)] 13:05:34.212280 run osmo-stp_10.42.42.5(pid=24225): stdout: | (launched: 2022-12-13_13:05:32.755866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:34.354476 run osmo-stp_10.42.42.5(pid=24225): stderr: | 20221213130532953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130532953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130532953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130532953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130532954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130532954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130532954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:34.494824 run osmo-stp_10.42.42.5(pid=24225): stdout: | (launched: 2022-12-13_13:05:32.755866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:34.627901 run osmo-stp_10.42.42.5(pid=24225): stderr: | 20221213130532953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130532953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130532953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130532953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130532954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130532954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130532954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:34.787584 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24225): Process ended prematurely: osmo-stp_10.42.42.5(pid=24225) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24225)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:05:34.797446 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 13:05:34.825081 run osmo-hlr_10.42.42.2(pid=24222): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24222)] 13:05:34.875719 run osmo-hlr_10.42.42.2(pid=24222): stdout: | (launched: 2022-12-13_13:05:31.389515) 13:05:34.927884 run osmo-hlr_10.42.42.2(pid=24222): stderr: | 20221213130531615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130531615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130531615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130531615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130531615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130531615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130531635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130531643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130531643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130531643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:35.000002 run osmo-msc_10.42.42.6(pid=24228): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24228)] 13:05:35.049914 run osmo-msc_10.42.42.6(pid=24228): stdout: | (launched: 2022-12-13_13:05:33.823012) 13:05:35.102036 run osmo-msc_10.42.42.6(pid=24228): stderr: | 20221213130534151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130534151 DLGLOBAL DEBUG validating counter group 0x7f8a61b26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130534151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130534151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130534151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130534152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130534153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130534154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130534154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130534154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:35.154285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24221): Terminating (SIGTERM) 13:05:35.196424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24224): Terminating (SIGTERM) 13:05:35.238841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24227): Terminating (SIGTERM) 13:05:35.281112 --- ParallelTerminationStrategy: PID 24221 died... 13:05:35.301403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24221): Terminated: ok {rc=0} 13:05:35.348045 --- ParallelTerminationStrategy: PID 24224 died... 13:05:35.367848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24224): Terminated: ok {rc=0} 13:05:35.414798 --- ParallelTerminationStrategy: PID 24227 died... 13:05:35.435004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24227): Terminated: ok {rc=0} 13:05:35.525557 bus /sierra_3: Setting Powered False 13:05:36.625761 bus /sierra_3: Setting Powered False 13:05:37.744845 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:05:38.894263 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:38.906200 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:05:38.962473 tst mo_mt_call_osmux.py: using LAC 34138 13:05:39.084817 tst mo_mt_call_osmux.py: using RAC 223 13:05:39.209431 tst mo_mt_call_osmux.py: using CellId 34138 13:05:39.333510 tst mo_mt_call_osmux.py: using BVCI 34139 13:05:39.447692 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.458823 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.469725 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.480531 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.491446 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.502484 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:39.625045 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:39.747426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:40.232233 run create_hlr_db(pid=24231): Launched 13:05:40.359633 bus /sierra_2: Setting Powered False 13:05:41.420559 run create_hlr_db(pid=24231): Terminated: ok {rc=0} 13:05:41.853596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Launched 13:05:42.190553 run osmo-hlr_10.42.42.2(pid=24234): Launched 13:05:42.318623 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:42.895075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Launched 13:05:43.229264 run osmo-stp_10.42.42.5(pid=24237): Launched 13:05:43.356371 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:43.956306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24239): Launched 13:05:44.292134 run osmo-msc_10.42.42.6(pid=24240): Launched 13:05:44.477149 run osmo-stp_10.42.42.5(pid=24237): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] 13:05:44.618378 run osmo-stp_10.42.42.5(pid=24237): stdout: | (launched: 2022-12-13_13:05:43.166451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:44.758371 run osmo-stp_10.42.42.5(pid=24237): stderr: | 20221213130543359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130543360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130543361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130543361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130543363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130543364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130543364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:44.896581 run osmo-stp_10.42.42.5(pid=24237): stdout: | (launched: 2022-12-13_13:05:43.166451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:45.027908 run osmo-stp_10.42.42.5(pid=24237): stderr: | 20221213130543359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130543360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130543361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130543361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130543363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130543364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130543364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:45.185515 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24237): Process ended prematurely: osmo-stp_10.42.42.5(pid=24237) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:05:45.195580 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:05:45.223090 run osmo-hlr_10.42.42.2(pid=24234): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24234)] 13:05:45.273421 run osmo-hlr_10.42.42.2(pid=24234): stdout: | (launched: 2022-12-13_13:05:42.128125) 13:05:45.325322 run osmo-hlr_10.42.42.2(pid=24234): stderr: | 20221213130542329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130542329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130542329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130542329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130542329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130542329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130542342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130542350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130542350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130542350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:45.397138 run osmo-msc_10.42.42.6(pid=24240): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24240)] 13:05:45.446789 run osmo-msc_10.42.42.6(pid=24240): stdout: | (launched: 2022-12-13_13:05:44.229489) 13:05:45.498444 run osmo-msc_10.42.42.6(pid=24240): stderr: | 20221213130544554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130544554 DLGLOBAL DEBUG validating counter group 0x7f30b91fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130544554 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130544555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130544555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130544555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130544557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130544557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130544557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130544557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:45.550157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Terminating (SIGTERM) 13:05:45.591792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Terminating (SIGTERM) 13:05:45.633977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24239): Terminating (SIGTERM) 13:05:45.675920 --- ParallelTerminationStrategy: PID 24233 died... 13:05:45.696110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Terminated: ok {rc=0} 13:05:45.742217 --- ParallelTerminationStrategy: PID 24236 died... 13:05:45.761930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Terminated: ok {rc=0} 13:05:45.807820 --- ParallelTerminationStrategy: PID 24239 died... 13:05:45.827809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24239): Terminated: ok {rc=0} 13:05:45.928458 bus /sierra_3: Setting Powered False 13:05:47.028801 bus /sierra_3: Setting Powered False 13:05:48.144648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:05:49.379828 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:49.386935 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:05:49.408275 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:05:49.437386 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:05:49.493110 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:05:49.514572 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:05:49.542122 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:05:50.089637 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:05:50.140084 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.151493 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:05:50.208078 tst mo_mt_call.py: using LAC 34139 13:05:50.340136 tst mo_mt_call.py: using RAC 224 13:05:50.470681 tst mo_mt_call.py: using CellId 34139 13:05:50.601321 tst mo_mt_call.py: using BVCI 34140 13:05:50.723263 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.734990 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.746616 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.758279 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.770069 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.781931 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:05:50.900451 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:05:51.021564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:51.539256 run create_hlr_db(pid=24245): Launched 13:05:51.665903 bus /sierra_2: Setting Powered False 13:05:52.727686 run create_hlr_db(pid=24245): Terminated: ok {rc=0} 13:05:53.193115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24249): Launched 13:05:53.528321 run osmo-hlr_10.42.42.2(pid=24250): Launched 13:05:53.655764 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:54.233624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24252): Launched 13:05:54.568473 run osmo-stp_10.42.42.5(pid=24253): Launched 13:05:54.695836 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:55.299820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24255): Launched 13:05:55.634801 run osmo-msc_10.42.42.6(pid=24256): Launched 13:05:55.819798 run osmo-stp_10.42.42.5(pid=24253): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24253)] 13:05:55.960668 run osmo-stp_10.42.42.5(pid=24253): stdout: | (launched: 2022-12-13_13:05:54.505561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:56.101222 run osmo-stp_10.42.42.5(pid=24253): stderr: | 20221213130554700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130554700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130554700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130554700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130554703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130554703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130554703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:56.240823 run osmo-stp_10.42.42.5(pid=24253): stdout: | (launched: 2022-12-13_13:05:54.505561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:56.373386 run osmo-stp_10.42.42.5(pid=24253): stderr: | 20221213130554700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130554700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130554700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130554700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130554703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130554703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130554703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:56.531649 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24253): Process ended prematurely: osmo-stp_10.42.42.5(pid=24253) [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24253)] [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:05:56.541327 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:05:56.569365 run osmo-hlr_10.42.42.2(pid=24250): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24250)] 13:05:56.620629 run osmo-hlr_10.42.42.2(pid=24250): stdout: | (launched: 2022-12-13_13:05:53.466009) 13:05:56.673366 run osmo-hlr_10.42.42.2(pid=24250): stderr: | 20221213130553668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130553668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130553668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130553668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130553668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130553669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130553680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130553689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130553689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130553689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:56.746161 run osmo-msc_10.42.42.6(pid=24256): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24256)] 13:05:56.796579 run osmo-msc_10.42.42.6(pid=24256): stdout: | (launched: 2022-12-13_13:05:55.572138) 13:05:56.849506 run osmo-msc_10.42.42.6(pid=24256): stderr: | 20221213130555897 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130555897 DLGLOBAL DEBUG validating counter group 0x7fd19ae49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130555897 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130555897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130555897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130555898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130555899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130555899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130555900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130555900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:56.902312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24249): Terminating (SIGTERM) 13:05:56.944505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24252): Terminating (SIGTERM) 13:05:56.987128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24255): Terminating (SIGTERM) 13:05:57.030092 --- ParallelTerminationStrategy: PID 24249 died... 13:05:57.050586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24249): Terminated: ok {rc=0} 13:05:57.097887 --- ParallelTerminationStrategy: PID 24252 died... 13:05:57.118026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24252): Terminated: ok {rc=0} 13:05:57.165095 --- ParallelTerminationStrategy: PID 24255 died... 13:05:57.185246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24255): Terminated: ok {rc=0} 13:05:57.275284 bus /sierra_3: Setting Powered False 13:05:58.374326 bus /sierra_3: Setting Powered False 13:05:59.490776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:06:00.640881 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:00.653352 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:06:00.715283 tst mo_mt_call_osmux.py: using LAC 34140 13:06:00.845358 tst mo_mt_call_osmux.py: using RAC 225 13:06:00.987535 tst mo_mt_call_osmux.py: using CellId 34140 13:06:01.120550 tst mo_mt_call_osmux.py: using BVCI 34141 13:06:01.272459 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.284748 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.296863 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.309122 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.322510 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.335250 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:01.456618 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:01.581229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:02.107731 run create_hlr_db(pid=24258): Launched 13:06:02.269089 bus /sierra_2: Setting Powered False 13:06:03.334207 run create_hlr_db(pid=24258): Terminated: ok {rc=0} 13:06:03.796651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24260): Launched 13:06:04.131400 run osmo-hlr_10.42.42.2(pid=24261): Launched 13:06:04.259310 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:04.838822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24263): Launched 13:06:05.156000 run osmo-stp_10.42.42.5(pid=24264): Launched 13:06:05.274129 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:05.837016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24266): Launched 13:06:06.149376 run osmo-msc_10.42.42.6(pid=24267): Launched 13:06:06.324398 run osmo-stp_10.42.42.5(pid=24264): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24264)] 13:06:06.456539 run osmo-stp_10.42.42.5(pid=24264): stdout: | (launched: 2022-12-13_13:06:05.097384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:06.588725 run osmo-stp_10.42.42.5(pid=24264): stderr: | 20221213130605272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130605272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130605272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130605273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130605273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130605273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130605274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:06.719031 run osmo-stp_10.42.42.5(pid=24264): stdout: | (launched: 2022-12-13_13:06:05.097384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:06.843266 run osmo-stp_10.42.42.5(pid=24264): stderr: | 20221213130605272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130605272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130605272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130605273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130605273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130605273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130605274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:06.991780 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24264): Process ended prematurely: osmo-stp_10.42.42.5(pid=24264) [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24264)] [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:06:07.001017 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:06:07.027207 run osmo-hlr_10.42.42.2(pid=24261): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24261)] 13:06:07.074911 run osmo-hlr_10.42.42.2(pid=24261): stdout: | (launched: 2022-12-13_13:06:04.068646) 13:06:07.124405 run osmo-hlr_10.42.42.2(pid=24261): stderr: | 20221213130604272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130604272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130604272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130604272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130604272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130604272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130604286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130604295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130604296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130604296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:07.193334 run osmo-msc_10.42.42.6(pid=24267): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24267)] 13:06:07.240845 run osmo-msc_10.42.42.6(pid=24267): stdout: | (launched: 2022-12-13_13:06:06.090329) 13:06:07.290062 run osmo-msc_10.42.42.6(pid=24267): stderr: | 20221213130606370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130606370 DLGLOBAL DEBUG validating counter group 0x7fdda9932c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130606370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130606370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130606371 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130606371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130606373 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130606373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130606373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130606373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:07.339427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24260): Terminating (SIGTERM) 13:06:07.378980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24263): Terminating (SIGTERM) 13:06:07.418579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24266): Terminating (SIGTERM) 13:06:07.458320 --- ParallelTerminationStrategy: PID 24260 died... 13:06:07.477709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24260): Terminated: ok {rc=0} 13:06:07.522032 --- ParallelTerminationStrategy: PID 24263 died... 13:06:07.540634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24263): Terminated: ok {rc=0} 13:06:07.584435 --- ParallelTerminationStrategy: PID 24266 died... 13:06:07.602941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24266): Terminated: ok {rc=0} 13:06:07.685532 bus /sierra_3: Setting Powered False 13:06:08.783063 bus /sierra_3: Setting Powered False 13:06:09.902375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:06:11.135974 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:11.141597 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:06:11.162420 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:06:11.189305 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:06:11.240930 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:06:11.262173 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:06:11.288900 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:06:11.841474 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:06:11.896535 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:11.908032 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:06:11.966676 tst mo_mt_call.py: using LAC 34141 13:06:12.098760 tst mo_mt_call.py: using RAC 226 13:06:12.229029 tst mo_mt_call.py: using CellId 34141 13:06:12.359329 tst mo_mt_call.py: using BVCI 34142 13:06:12.482586 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.494282 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.505667 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.516794 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.528492 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.540081 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:12.659148 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:12.784817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:13.302670 run create_hlr_db(pid=24272): Launched 13:06:13.429371 bus /sierra_2: Setting Powered False 13:06:14.494390 run create_hlr_db(pid=24272): Terminated: ok {rc=0} 13:06:14.939868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24274): Launched 13:06:15.274885 run osmo-hlr_10.42.42.2(pid=24275): Launched 13:06:15.402694 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:15.993762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24277): Launched 13:06:16.352851 run osmo-stp_10.42.42.5(pid=24278): Launched 13:06:16.509622 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:17.220695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24280): Launched 13:06:17.568587 run osmo-msc_10.42.42.6(pid=24281): Launched 13:06:17.754985 run osmo-stp_10.42.42.5(pid=24278): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24278)] 13:06:17.897562 run osmo-stp_10.42.42.5(pid=24278): stdout: | (launched: 2022-12-13_13:06:16.282534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:18.038780 run osmo-stp_10.42.42.5(pid=24278): stderr: | 20221213130616652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130616652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130616652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130616667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130616668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130616668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130616668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.178110 run osmo-stp_10.42.42.5(pid=24278): stdout: | (launched: 2022-12-13_13:06:16.282534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:18.310641 run osmo-stp_10.42.42.5(pid=24278): stderr: | 20221213130616652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130616652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130616652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130616667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130616668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130616668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130616668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.469292 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24278): Process ended prematurely: osmo-stp_10.42.42.5(pid=24278) [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24278)] [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:06:18.479033 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:06:18.506665 run osmo-hlr_10.42.42.2(pid=24275): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24275)] 13:06:18.557514 run osmo-hlr_10.42.42.2(pid=24275): stdout: | (launched: 2022-12-13_13:06:15.212139) 13:06:18.609536 run osmo-hlr_10.42.42.2(pid=24275): stderr: | 20221213130615413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130615414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130615414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130615414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130615414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130615414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130615424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130615433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130615433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130615433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:18.681823 run osmo-msc_10.42.42.6(pid=24281): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24281)] 13:06:18.731668 run osmo-msc_10.42.42.6(pid=24281): stdout: | (launched: 2022-12-13_13:06:17.505406) 13:06:18.783767 run osmo-msc_10.42.42.6(pid=24281): stderr: | 20221213130617831 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130617832 DLGLOBAL DEBUG validating counter group 0x7ff1830a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130617832 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130617832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130617832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130617832 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130617834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130617834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130617834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130617834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:18.835955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24274): Terminating (SIGTERM) 13:06:18.878069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24277): Terminating (SIGTERM) 13:06:18.920227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24280): Terminating (SIGTERM) 13:06:18.962644 --- ParallelTerminationStrategy: PID 24274 died... 13:06:18.982963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24274): Terminated: ok {rc=0} 13:06:19.029509 --- ParallelTerminationStrategy: PID 24277 died... 13:06:19.049349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24277): Terminated: ok {rc=0} 13:06:19.095668 --- ParallelTerminationStrategy: PID 24280 died... 13:06:19.115453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24280): Terminated: ok {rc=0} 13:06:19.203605 bus /sierra_3: Setting Powered False 13:06:20.302574 bus /sierra_3: Setting Powered False 13:06:21.419403 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:06:22.570658 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:22.582713 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:06:22.642388 tst mo_mt_call_osmux.py: using LAC 34142 13:06:22.774392 tst mo_mt_call_osmux.py: using RAC 227 13:06:22.904442 tst mo_mt_call_osmux.py: using CellId 34142 13:06:23.036611 tst mo_mt_call_osmux.py: using BVCI 34143 13:06:23.159684 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.171152 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.182500 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.193739 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.205285 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.217364 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:23.335168 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:23.459704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:23.947800 run create_hlr_db(pid=24283): Launched 13:06:24.075857 bus /sierra_2: Setting Powered False 13:06:25.137085 run create_hlr_db(pid=24283): Terminated: ok {rc=0} 13:06:25.593588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Launched 13:06:25.930079 run osmo-hlr_10.42.42.2(pid=24286): Launched 13:06:26.056611 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:26.637464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Launched 13:06:26.974694 run osmo-stp_10.42.42.5(pid=24289): Launched 13:06:27.101843 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:27.705643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24291): Launched 13:06:28.042222 run osmo-msc_10.42.42.6(pid=24292): Launched 13:06:28.227913 run osmo-stp_10.42.42.5(pid=24289): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24289)] 13:06:28.367948 run osmo-stp_10.42.42.5(pid=24289): stdout: | (launched: 2022-12-13_13:06:26.911487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:28.508908 run osmo-stp_10.42.42.5(pid=24289): stderr: | 20221213130627108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130627108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130627109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130627109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130627110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130627110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130627110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:28.647926 run osmo-stp_10.42.42.5(pid=24289): stdout: | (launched: 2022-12-13_13:06:26.911487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:28.779740 run osmo-stp_10.42.42.5(pid=24289): stderr: | 20221213130627108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130627108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130627109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130627109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130627110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130627110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130627110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:28.937457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24289): Process ended prematurely: osmo-stp_10.42.42.5(pid=24289) [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24289)] [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:06:28.947052 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:06:28.974767 run osmo-hlr_10.42.42.2(pid=24286): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24286)] 13:06:29.026101 run osmo-hlr_10.42.42.2(pid=24286): stdout: | (launched: 2022-12-13_13:06:25.867337) 13:06:29.078359 run osmo-hlr_10.42.42.2(pid=24286): stderr: | 20221213130626072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130626072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130626072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130626072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130626072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130626072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130626083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130626091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130626092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130626092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:29.150913 run osmo-msc_10.42.42.6(pid=24292): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24292)] 13:06:29.201705 run osmo-msc_10.42.42.6(pid=24292): stdout: | (launched: 2022-12-13_13:06:27.979324) 13:06:29.254093 run osmo-msc_10.42.42.6(pid=24292): stderr: | 20221213130628305 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130628305 DLGLOBAL DEBUG validating counter group 0x7f17c734cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130628305 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130628305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130628306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130628306 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130628307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130628308 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130628308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130628308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:29.306843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Terminating (SIGTERM) 13:06:29.349027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Terminating (SIGTERM) 13:06:29.391312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24291): Terminating (SIGTERM) 13:06:29.433628 --- ParallelTerminationStrategy: PID 24285 died... 13:06:29.453919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Terminated: ok {rc=0} 13:06:29.500497 --- ParallelTerminationStrategy: PID 24288 died... 13:06:29.520299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Terminated: ok {rc=0} 13:06:29.566922 --- ParallelTerminationStrategy: PID 24291 died... 13:06:29.586860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24291): Terminated: ok {rc=0} 13:06:29.675637 bus /sierra_3: Setting Powered False 13:06:30.774063 bus /sierra_3: Setting Powered False 13:06:31.903733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:sysmo --------------------------------------------------------------------- 13:06:33.133028 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:33.137332 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 13:06:33.158127 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 13:06:33.185356 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 13:06:33.270308 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 13:06:33.291171 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 13:06:33.317785 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 13:06:33.905194 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 13:06:33.911487 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:33.923220 tst emergency:sysmo: Using 1 x bts (candidates: 1) 13:06:33.962237 tst emergency_mo_mt_call.py: using LAC 34143 13:06:34.091865 tst emergency_mo_mt_call.py: using RAC 228 13:06:34.221318 tst emergency_mo_mt_call.py: using CellId 34143 13:06:34.350047 tst emergency_mo_mt_call.py: using BVCI 34144 13:06:34.468792 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:34.479980 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:34.491125 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:34.502183 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:34.514048 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:34.526058 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:34.644390 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:34.765239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:35.272335 run create_hlr_db(pid=24297): Launched 13:06:35.397116 bus /sierra_2: Setting Powered False 13:06:36.460082 run create_hlr_db(pid=24297): Terminated: ok {rc=0} 13:06:36.899419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24299): Launched 13:06:37.207648 run osmo-hlr_10.42.42.2(pid=24300): Launched 13:06:37.323829 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:37.870410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24302): Launched 13:06:38.179416 run osmo-stp_10.42.42.5(pid=24303): Launched 13:06:38.306010 tst emergency_mo_mt_call.py: using MSISDN 8175 13:06:38.464596 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:39.021754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24305): Launched 13:06:39.331500 run osmo-msc_10.42.42.6(pid=24306): Launched 13:06:39.502723 run osmo-stp_10.42.42.5(pid=24303): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24303)] 13:06:39.631980 run osmo-stp_10.42.42.5(pid=24303): stdout: | (launched: 2022-12-13_13:06:38.120918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:39.761787 run osmo-stp_10.42.42.5(pid=24303): stderr: | 20221213130638296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130638296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130638296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130638297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130638297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130638297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130638297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:39.889649 run osmo-stp_10.42.42.5(pid=24303): stdout: | (launched: 2022-12-13_13:06:38.120918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:40.012187 run osmo-stp_10.42.42.5(pid=24303): stderr: | 20221213130638296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130638296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130638296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130638297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130638297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130638297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130638297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:40.158053 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24303): Process ended prematurely: osmo-stp_10.42.42.5(pid=24303) [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24303)] [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py:19] 13:06:40.166528 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 13:06:40.192797 run osmo-hlr_10.42.42.2(pid=24300): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24300)] 13:06:40.242032 run osmo-hlr_10.42.42.2(pid=24300): stdout: | (launched: 2022-12-13_13:06:37.149412) 13:06:40.291904 run osmo-hlr_10.42.42.2(pid=24300): stderr: | 20221213130637331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130637331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130637331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130637331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130637331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130637331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130637343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130637354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130637354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130637354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:40.361865 run osmo-msc_10.42.42.6(pid=24306): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24306)] 13:06:40.410128 run osmo-msc_10.42.42.6(pid=24306): stdout: | (launched: 2022-12-13_13:06:39.273128) 13:06:40.459919 run osmo-msc_10.42.42.6(pid=24306): stderr: | 20221213130639549 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130639549 DLGLOBAL DEBUG validating counter group 0x7f25b6b4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130639549 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130639550 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130639550 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130639550 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130639552 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130639552 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130639552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130639552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:40.510150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24299): Terminating (SIGTERM) 13:06:40.550884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24302): Terminating (SIGTERM) 13:06:40.591890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24305): Terminating (SIGTERM) 13:06:40.632508 --- ParallelTerminationStrategy: PID 24299 died... 13:06:40.652062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24299): Terminated: ok {rc=0} 13:06:40.696631 --- ParallelTerminationStrategy: PID 24302 died... 13:06:40.715587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24302): Terminated: ok {rc=0} 13:06:40.760400 --- ParallelTerminationStrategy: PID 24305 died... 13:06:40.779476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24305): Terminated: ok {rc=0} 13:06:40.867022 bus /sierra_3: Setting Powered False 13:06:41.965879 bus /sierra_3: Setting Powered False 13:06:43.079547 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 13:06:44.167005 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.179080 tst emergency:sysmo: Using 1 x bts (candidates: 1) 13:06:44.218133 tst emergency_preemptive_call.py: using LAC 34144 13:06:44.348368 tst emergency_preemptive_call.py: using RAC 229 13:06:44.472711 tst emergency_preemptive_call.py: using CellId 34144 13:06:44.593384 tst emergency_preemptive_call.py: using BVCI 34145 13:06:44.706694 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.717669 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.728389 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.739097 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.749593 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 13:06:44.760160 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:44.881051 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:45.000295 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:45.119427 tst emergency:sysmo: Using 1 x modem (candidates: 4) 13:06:45.235287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:45.711442 run create_hlr_db(pid=24308): Launched 13:06:45.835973 bus /sierra_2: Setting Powered False 13:06:46.897214 run create_hlr_db(pid=24308): Terminated: ok {rc=0} 13:06:47.337742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24310): Launched 13:06:47.647930 run osmo-hlr_10.42.42.2(pid=24311): Launched 13:06:47.764919 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:48.310974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24313): Launched 13:06:48.620044 run osmo-stp_10.42.42.5(pid=24314): Launched 13:06:48.750216 tst emergency_preemptive_call.py: using MSISDN 8176 13:06:48.906565 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:49.461117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24316): Launched 13:06:49.769283 run osmo-msc_10.42.42.6(pid=24317): Launched 13:06:49.947149 run osmo-stp_10.42.42.5(pid=24314): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24314)] 13:06:50.077247 run osmo-stp_10.42.42.5(pid=24314): stdout: | (launched: 2022-12-13_13:06:48.561080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:50.207386 run osmo-stp_10.42.42.5(pid=24314): stderr: | 20221213130648735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130648735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130648735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130648736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130648736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130648736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130648736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:50.335319 run osmo-stp_10.42.42.5(pid=24314): stdout: | (launched: 2022-12-13_13:06:48.561080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:50.456307 run osmo-stp_10.42.42.5(pid=24314): stderr: | 20221213130648735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130648735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130648735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130648736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130648736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130648736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130648736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:50.602335 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24314): Process ended prematurely: osmo-stp_10.42.42.5(pid=24314) [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24314)] [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py:32] 13:06:50.610946 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:06:50.637120 run osmo-hlr_10.42.42.2(pid=24311): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24311)] 13:06:50.684532 run osmo-hlr_10.42.42.2(pid=24311): stdout: | (launched: 2022-12-13_13:06:47.589610) 13:06:50.733324 run osmo-hlr_10.42.42.2(pid=24311): stderr: | 20221213130647770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130647770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130647770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130647770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130647770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130647770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130647783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130647794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130647794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130647794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:50.801615 run osmo-msc_10.42.42.6(pid=24317): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24317)] 13:06:50.848681 run osmo-msc_10.42.42.6(pid=24317): stdout: | (launched: 2022-12-13_13:06:49.710097) 13:06:50.897486 run osmo-msc_10.42.42.6(pid=24317): stderr: | 20221213130649987 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213130649987 DLGLOBAL DEBUG validating counter group 0x7f75ff744c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213130649988 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213130649988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213130649988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213130649988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213130649990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213130649990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213130649991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213130649991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:50.946572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24310): Terminating (SIGTERM) 13:06:50.986042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24313): Terminating (SIGTERM) 13:06:51.025425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24316): Terminating (SIGTERM) 13:06:51.065620 --- ParallelTerminationStrategy: PID 24310 died... 13:06:51.084745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24310): Terminated: ok {rc=0} 13:06:51.128612 --- ParallelTerminationStrategy: PID 24313 died... 13:06:51.147344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24313): Terminated: ok {rc=0} 13:06:51.191186 --- ParallelTerminationStrategy: PID 24316 died... 13:06:51.209859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24316): Terminated: ok {rc=0} 13:06:51.293231 bus /sierra_9: Setting Powered False 13:06:52.390940 bus /sierra_9: Setting Powered False 13:06:53.509665 bus /sierra_8: Setting Powered False 13:06:54.609457 bus /sierra_8: Setting Powered False 13:06:55.725547 bus /sierra_3: Setting Powered False 13:06:56.822550 bus /sierra_3: Setting Powered False 13:06:57.939804 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:sysmo --------------------------------------------------------------------- 13:06:59.197460 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:59.201674 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 13:06:59.222359 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 13:06:59.260612 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 13:06:59.349604 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 13:06:59.370874 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 13:06:59.409097 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 13:06:59.997616 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 13:07:00.049410 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.059876 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:07:00.094517 tst cs_paging_gprs_active.py: using LAC 34145 13:07:00.220094 tst cs_paging_gprs_active.py: using RAC 230 13:07:00.343164 tst cs_paging_gprs_active.py: using CellId 34145 13:07:00.465552 tst cs_paging_gprs_active.py: using BVCI 34146 13:07:00.590810 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.602147 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.613422 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.624429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.636363 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.648478 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.660492 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.672429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:00.684475 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:00.807628 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:00.946869 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:07:01.171751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:01.502549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24323): Launched 13:07:01.802372 run iperf3-srv_10.42.42.10(pid=24324): Launched 13:07:01.936110 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:07:02.151075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:02.492340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Launched 13:07:02.784486 run iperf3-srv_10.42.42.10(pid=24326): Launched 13:07:02.909782 tst cs_paging_gprs_active.py:38: start network... 13:07:03.134921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:03.654401 run create_hlr_db(pid=24327): Launched 13:07:03.782346 bus /sierra_2: Setting Powered False 13:07:04.847921 run create_hlr_db(pid=24327): Terminated: ok {rc=0} 13:07:05.295798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Launched 13:07:05.611092 run osmo-hlr_10.42.42.2(pid=24330): Launched 13:07:05.729922 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:06.269653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Launched 13:07:06.585383 run osmo-stp_10.42.42.5(pid=24333): Launched 13:07:06.704914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:08.228736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24335): Launched 13:07:08.348423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:08.614513 run patchelf(pid=24336): Launched 13:07:08.790667 run osmo-stp_10.42.42.5(pid=24333): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] 13:07:08.922737 run osmo-stp_10.42.42.5(pid=24333): stdout: | (launched: 2022-12-13_13:07:06.526009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:09.056384 run osmo-stp_10.42.42.5(pid=24333): stderr: | 20221213130706698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130706698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130706698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130706699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130706701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130706701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130706701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:09.189967 run osmo-stp_10.42.42.5(pid=24333): stdout: | (launched: 2022-12-13_13:07:06.526009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:09.318059 run osmo-stp_10.42.42.5(pid=24333): stderr: | 20221213130706698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130706698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130706698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130706699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130706701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130706701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130706701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:09.469815 run patchelf(pid=24336): Terminating (SIGINT) 13:07:09.644843 run patchelf(pid=24336): Terminated: ok {rc=0} 13:07:09.771726 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24333): Process ended prematurely: osmo-stp_10.42.42.5(pid=24333) [trial-2390↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] [trial-2390↪gprs:sysmo↪cs_paging_gprs_active.py:38] 13:07:09.781130 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 13:07:09.808216 run osmo-hlr_10.42.42.2(pid=24330): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24330)] 13:07:09.855875 run osmo-hlr_10.42.42.2(pid=24330): stdout: | (launched: 2022-12-13_13:07:05.551359) 13:07:09.905271 run osmo-hlr_10.42.42.2(pid=24330): stderr: | 20221213130705731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130705731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130705731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130705731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130705732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130705732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130705749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130705759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130705759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130705759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:09.955098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24323): Terminating (SIGTERM) 13:07:09.995232 run iperf3-srv_10.42.42.10(pid=24324): Terminating (SIGTERM) 13:07:10.034987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Terminating (SIGTERM) 13:07:10.074964 run iperf3-srv_10.42.42.10(pid=24326): Terminating (SIGTERM) 13:07:10.114899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Terminating (SIGTERM) 13:07:10.155121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Terminating (SIGTERM) 13:07:10.195068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24335): Terminating (SIGTERM) 13:07:10.235259 --- ParallelTerminationStrategy: PID 24323 died... 13:07:10.254615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24323): Terminated: ok {rc=0} 13:07:10.299071 --- ParallelTerminationStrategy: PID 24324 died... 13:07:10.317799 run iperf3-srv_10.42.42.10(pid=24324): Terminated {rc=256} 13:07:10.361762 --- ParallelTerminationStrategy: PID 24325 died... 13:07:10.380717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Terminated: ok {rc=0} 13:07:10.424791 --- ParallelTerminationStrategy: PID 24326 died... 13:07:10.443662 run iperf3-srv_10.42.42.10(pid=24326): Terminated {rc=256} 13:07:10.487628 --- ParallelTerminationStrategy: PID 24329 died... 13:07:10.506487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24329): Terminated: ok {rc=0} 13:07:10.550585 --- ParallelTerminationStrategy: PID 24332 died... 13:07:10.569444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24332): Terminated: ok {rc=0} 13:07:10.613572 --- ParallelTerminationStrategy: PID 24335 died... 13:07:10.632373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24335): Terminated: ok {rc=0} 13:07:10.719035 bus /gobi_0: Setting Powered False 13:07:11.819168 bus /gobi_0: Setting Powered False 13:07:12.932585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo iperf3.py ---------------------------------------------- 13:07:14.085782 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.097817 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:07:14.135757 tst iperf3.py: using LAC 34146 13:07:14.261261 tst iperf3.py: using RAC 231 13:07:14.393976 tst iperf3.py: using CellId 34146 13:07:14.524918 tst iperf3.py: using BVCI 34147 13:07:14.649325 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.660569 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.671859 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.683006 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.694362 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.705724 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.717186 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.728290 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:14.740093 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:14.861713 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:15.073981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:15.389300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24337): Launched 13:07:15.663306 run iperf3-srv_10.42.42.10(pid=24338): Launched 13:07:15.781231 tst iperf3.py:8: start network... 13:07:16.046312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:16.577504 run create_hlr_db(pid=24339): Launched 13:07:16.757878 bus /gobi_6: Setting Powered False 13:07:17.823506 run create_hlr_db(pid=24339): Terminated: ok {rc=0} 13:07:18.274048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Launched 13:07:18.588522 run osmo-hlr_10.42.42.2(pid=24342): Launched 13:07:18.707850 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:19.266410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Launched 13:07:19.579694 run osmo-stp_10.42.42.5(pid=24345): Launched 13:07:19.698614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:20.235871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Launched 13:07:20.354345 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:20.618907 run patchelf(pid=24348): Launched 13:07:20.791435 run osmo-stp_10.42.42.5(pid=24345): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] 13:07:20.923254 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-13_13:07:19.520377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:21.055981 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221213130719693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130719693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130719694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130719694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130719696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130719696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130719696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:21.189093 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-13_13:07:19.520377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:21.315990 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221213130719693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130719693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130719694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130719694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130719696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130719696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130719696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:21.466852 run patchelf(pid=24348): Terminating (SIGINT) 13:07:21.641826 run patchelf(pid=24348): Terminated: ok {rc=0} 13:07:21.767257 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2390↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] [trial-2390↪gprs:sysmo↪iperf3.py:8] 13:07:21.777406 tst iperf3.py:8: Test FAILED (7.7 sec) 13:07:21.804212 run osmo-hlr_10.42.42.2(pid=24342): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24342)] 13:07:21.851173 run osmo-hlr_10.42.42.2(pid=24342): stdout: | (launched: 2022-12-13_13:07:18.529280) 13:07:21.900423 run osmo-hlr_10.42.42.2(pid=24342): stderr: | 20221213130718709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130718709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130718709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130718710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130718710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130718710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130718722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130718730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130718730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130718730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:21.949590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24337): Terminating (SIGTERM) 13:07:21.989331 run iperf3-srv_10.42.42.10(pid=24338): Terminating (SIGTERM) 13:07:22.029116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminating (SIGTERM) 13:07:22.069242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminating (SIGTERM) 13:07:22.109242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Terminating (SIGTERM) 13:07:22.149955 --- ParallelTerminationStrategy: PID 24337 died... 13:07:22.169478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24337): Terminated: ok {rc=0} 13:07:22.213926 --- ParallelTerminationStrategy: PID 24338 died... 13:07:22.232863 run iperf3-srv_10.42.42.10(pid=24338): Terminated {rc=256} 13:07:22.277313 --- ParallelTerminationStrategy: PID 24341 died... 13:07:22.296212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminated: ok {rc=0} 13:07:22.340449 --- ParallelTerminationStrategy: PID 24344 died... 13:07:22.359255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminated: ok {rc=0} 13:07:22.403695 --- ParallelTerminationStrategy: PID 24347 died... 13:07:22.422517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Terminated: ok {rc=0} 13:07:22.509264 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo iperf3m4.py ---------------------------------------------- 13:07:23.657123 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:23.668448 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:07:23.705114 tst iperf3m4.py: using LAC 34147 13:07:23.827699 tst iperf3m4.py: using RAC 232 13:07:23.952419 tst iperf3m4.py: using CellId 34147 13:07:24.076108 tst iperf3m4.py: using BVCI 34148 13:07:24.199166 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.210390 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.221789 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.232861 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.244636 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.256056 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.267457 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.278793 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:24.290268 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:24.409694 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:24.532640 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:24.653254 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:24.775157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:25.001758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:25.339628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24349): Launched 13:07:25.632631 run iperf3-srv_10.42.42.10(pid=24350): Launched 13:07:25.759188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:07:25.985050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:26.322798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24351): Launched 13:07:26.614989 run iperf3-srv_10.42.42.10(pid=24352): Launched 13:07:26.740764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:07:26.967141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:27.304440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24353): Launched 13:07:27.596792 run iperf3-srv_10.42.42.10(pid=24354): Launched 13:07:27.722630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:07:27.947263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:28.284395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24355): Launched 13:07:28.595278 run iperf3-srv_10.42.42.10(pid=24356): Launched 13:07:28.713731 tst iperf3m4.py:8: start network... 13:07:28.923774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:29.410593 run create_hlr_db(pid=24357): Launched 13:07:29.537807 bus /gobi_6: Setting Powered False 13:07:30.599724 run create_hlr_db(pid=24357): Terminated: ok {rc=0} 13:07:31.061757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24359): Launched 13:07:31.420326 run osmo-hlr_10.42.42.2(pid=24360): Launched 13:07:31.601987 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:32.377975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24362): Launched 13:07:32.690999 run osmo-stp_10.42.42.5(pid=24363): Launched 13:07:32.810280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:33.349712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24365): Launched 13:07:33.469600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:33.737123 run patchelf(pid=24366): Launched 13:07:33.910306 run osmo-stp_10.42.42.5(pid=24363): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24363)] 13:07:34.041633 run osmo-stp_10.42.42.5(pid=24363): stdout: | (launched: 2022-12-13_13:07:32.631674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:34.175089 run osmo-stp_10.42.42.5(pid=24363): stderr: | 20221213130732806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130732806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130732806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130732807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130732809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130732809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130732809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:34.308466 run osmo-stp_10.42.42.5(pid=24363): stdout: | (launched: 2022-12-13_13:07:32.631674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:34.436063 run osmo-stp_10.42.42.5(pid=24363): stderr: | 20221213130732806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130732806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130732806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130732807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130732809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130732809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130732809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:34.587442 run patchelf(pid=24366): Terminating (SIGINT) 13:07:34.762619 run patchelf(pid=24366): Terminated: ok {rc=0} 13:07:34.888633 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24363): Process ended prematurely: osmo-stp_10.42.42.5(pid=24363) [trial-2390↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24363)] [trial-2390↪gprs:sysmo↪iperf3m4.py:8] 13:07:34.898219 tst iperf3m4.py:8: Test FAILED (11.3 sec) 13:07:34.925873 run osmo-hlr_10.42.42.2(pid=24360): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24360)] 13:07:34.974614 run osmo-hlr_10.42.42.2(pid=24360): stdout: | (launched: 2022-12-13_13:07:31.353285) 13:07:35.024762 run osmo-hlr_10.42.42.2(pid=24360): stderr: | 20221213130731715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130731715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130731715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130731716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130731716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130731716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130731735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130731747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130731748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130731748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:35.075060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24349): Terminating (SIGTERM) 13:07:35.115372 run iperf3-srv_10.42.42.10(pid=24350): Terminating (SIGTERM) 13:07:35.155452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24351): Terminating (SIGTERM) 13:07:35.195676 run iperf3-srv_10.42.42.10(pid=24352): Terminating (SIGTERM) 13:07:35.236284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24353): Terminating (SIGTERM) 13:07:35.276499 run iperf3-srv_10.42.42.10(pid=24354): Terminating (SIGTERM) 13:07:35.316598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24355): Terminating (SIGTERM) 13:07:35.356840 run iperf3-srv_10.42.42.10(pid=24356): Terminating (SIGTERM) 13:07:35.396871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24359): Terminating (SIGTERM) 13:07:35.437281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24362): Terminating (SIGTERM) 13:07:35.477390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24365): Terminating (SIGTERM) 13:07:35.517884 --- ParallelTerminationStrategy: PID 24349 died... 13:07:35.537073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24349): Terminated: ok {rc=0} 13:07:35.581425 --- ParallelTerminationStrategy: PID 24350 died... 13:07:35.599965 run iperf3-srv_10.42.42.10(pid=24350): Terminated {rc=256} 13:07:35.644156 --- ParallelTerminationStrategy: PID 24351 died... 13:07:35.663018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24351): Terminated: ok {rc=0} 13:07:35.707851 --- ParallelTerminationStrategy: PID 24352 died... 13:07:35.727210 run iperf3-srv_10.42.42.10(pid=24352): Terminated {rc=256} 13:07:35.773398 --- ParallelTerminationStrategy: PID 24353 died... 13:07:35.803636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24353): Terminated: ok {rc=0} 13:07:35.854116 --- ParallelTerminationStrategy: PID 24354 died... 13:07:35.872924 run iperf3-srv_10.42.42.10(pid=24354): Terminated {rc=256} 13:07:35.917129 --- ParallelTerminationStrategy: PID 24355 died... 13:07:35.935680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24355): Terminated: ok {rc=0} 13:07:35.979389 --- ParallelTerminationStrategy: PID 24356 died... 13:07:35.998276 run iperf3-srv_10.42.42.10(pid=24356): Terminated {rc=256} 13:07:36.042146 --- ParallelTerminationStrategy: PID 24359 died... 13:07:36.060863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24359): Terminated: ok {rc=0} 13:07:36.104677 --- ParallelTerminationStrategy: PID 24362 died... 13:07:36.123573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24362): Terminated: ok {rc=0} 13:07:36.167510 --- ParallelTerminationStrategy: PID 24365 died... 13:07:36.186215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24365): Terminated: ok {rc=0} 13:07:36.272276 bus /gobi_4: Setting Powered False 13:07:37.372896 bus /gobi_4: Setting Powered False 13:07:38.488799 bus /gobi_1: Setting Powered False 13:07:39.590669 bus /gobi_1: Setting Powered False 13:07:40.709776 bus /gobi_0: Setting Powered False 13:07:41.808748 bus /gobi_0: Setting Powered False 13:07:42.923448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo ping.py ---------------------------------------------- 13:07:44.027500 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.039440 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:07:44.080290 tst ping.py: using LAC 34148 13:07:44.203862 tst ping.py: using RAC 233 13:07:44.326279 tst ping.py: using CellId 34148 13:07:44.447545 tst ping.py: using BVCI 34149 13:07:44.561566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.572304 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.583162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.593656 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.603923 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.615093 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.626024 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:44.636859 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:44.753190 tst ping.py:19: start network... 13:07:44.958603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:45.435889 run create_hlr_db(pid=24375): Launched 13:07:45.560041 bus /gobi_6: Setting Powered False 13:07:46.623932 run create_hlr_db(pid=24375): Terminated: ok {rc=0} 13:07:47.096261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24377): Launched 13:07:47.438649 run osmo-hlr_10.42.42.2(pid=24378): Launched 13:07:47.563818 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:48.130187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24380): Launched 13:07:48.460205 run osmo-stp_10.42.42.5(pid=24381): Launched 13:07:48.584887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:49.151612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Launched 13:07:49.277095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:49.555532 run patchelf(pid=24384): Launched 13:07:49.739634 run osmo-stp_10.42.42.5(pid=24381): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] 13:07:49.878536 run osmo-stp_10.42.42.5(pid=24381): stdout: | (launched: 2022-12-13_13:07:48.398443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:50.019107 run osmo-stp_10.42.42.5(pid=24381): stderr: | 20221213130748592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130748592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130748592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130748593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130748593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130748593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130748593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:50.159747 run osmo-stp_10.42.42.5(pid=24381): stdout: | (launched: 2022-12-13_13:07:48.398443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:50.294325 run osmo-stp_10.42.42.5(pid=24381): stderr: | 20221213130748592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130748592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130748592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130748593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130748593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130748593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130748593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:50.453448 run patchelf(pid=24384): Terminating (SIGINT) 13:07:50.636898 run patchelf(pid=24384): Terminated: ok {rc=0} 13:07:50.769380 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24381): Process ended prematurely: osmo-stp_10.42.42.5(pid=24381) [trial-2390↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] [trial-2390↪gprs:sysmo↪ping.py:22] 13:07:50.779138 tst ping.py:22: Test FAILED (6.7 sec) 13:07:50.807293 run osmo-hlr_10.42.42.2(pid=24378): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24378)] 13:07:50.858244 run osmo-hlr_10.42.42.2(pid=24378): stdout: | (launched: 2022-12-13_13:07:47.376461) 13:07:50.910303 run osmo-hlr_10.42.42.2(pid=24378): stderr: | 20221213130747577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130747577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130747577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130747577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130747577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130747577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130747590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130747598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130747598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130747598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:50.962616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24377): Terminating (SIGTERM) 13:07:51.004478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24380): Terminating (SIGTERM) 13:07:51.047253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Terminating (SIGTERM) 13:07:51.090100 --- ParallelTerminationStrategy: PID 24377 died... 13:07:51.110745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24377): Terminated: ok {rc=0} 13:07:51.157507 --- ParallelTerminationStrategy: PID 24380 died... 13:07:51.177595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24380): Terminated: ok {rc=0} 13:07:51.224086 --- ParallelTerminationStrategy: PID 24383 died... 13:07:51.244381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Terminated: ok {rc=0} 13:07:51.333472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 13:07:52.420909 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:52.432830 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:07:52.469747 tst ping_idle_ping.py: using LAC 34149 13:07:52.595500 tst ping_idle_ping.py: using RAC 234 13:07:52.717486 tst ping_idle_ping.py: using CellId 34149 13:07:52.840762 tst ping_idle_ping.py: using BVCI 34150 13:07:52.953244 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:52.963740 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:52.974252 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:52.984658 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:52.995028 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:53.005847 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:53.016695 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:07:53.027671 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:07:53.157382 tst ping_idle_ping.py:24: start network... 13:07:53.380070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:53.889170 run create_hlr_db(pid=24385): Launched 13:07:54.015887 bus /gobi_6: Setting Powered False 13:07:55.076506 run create_hlr_db(pid=24385): Terminated: ok {rc=0} 13:07:55.517641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24387): Launched 13:07:55.825911 run osmo-hlr_10.42.42.2(pid=24388): Launched 13:07:55.942076 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:56.478725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24390): Launched 13:07:56.785635 run osmo-stp_10.42.42.5(pid=24391): Launched 13:07:56.901247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:57.433309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24393): Launched 13:07:57.550325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:57.811289 run patchelf(pid=24394): Launched 13:07:57.981488 run osmo-stp_10.42.42.5(pid=24391): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24391)] 13:07:58.110833 run osmo-stp_10.42.42.5(pid=24391): stdout: | (launched: 2022-12-13_13:07:56.727853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:58.242375 run osmo-stp_10.42.42.5(pid=24391): stderr: | 20221213130756901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130756901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130756901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130756902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130756904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130756904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130756904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:58.373738 run osmo-stp_10.42.42.5(pid=24391): stdout: | (launched: 2022-12-13_13:07:56.727853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:58.499120 run osmo-stp_10.42.42.5(pid=24391): stderr: | 20221213130756901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130756901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130756901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130756902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130756904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130756904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130756904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:58.647433 run patchelf(pid=24394): Terminating (SIGINT) 13:07:58.818818 run patchelf(pid=24394): Terminated: ok {rc=0} 13:07:58.942400 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24391): Process ended prematurely: osmo-stp_10.42.42.5(pid=24391) [trial-2390↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24391)] [trial-2390↪gprs:sysmo↪ping_idle_ping.py:27] 13:07:58.951179 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:07:58.977482 run osmo-hlr_10.42.42.2(pid=24388): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24388)] 13:07:59.024292 run osmo-hlr_10.42.42.2(pid=24388): stdout: | (launched: 2022-12-13_13:07:55.767685) 13:07:59.072916 run osmo-hlr_10.42.42.2(pid=24388): stderr: | 20221213130755947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130755947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130755947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130755947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130755947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130755947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130755959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130755969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130755970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130755970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:59.122076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24387): Terminating (SIGTERM) 13:07:59.161980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24390): Terminating (SIGTERM) 13:07:59.201346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24393): Terminating (SIGTERM) 13:07:59.241297 --- ParallelTerminationStrategy: PID 24387 died... 13:07:59.260163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24387): Terminated: ok {rc=0} 13:07:59.303600 --- ParallelTerminationStrategy: PID 24390 died... 13:07:59.322076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24390): Terminated: ok {rc=0} 13:07:59.365429 --- ParallelTerminationStrategy: PID 24393 died... 13:07:59.383719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24393): Terminated: ok {rc=0} 13:07:59.468544 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 13:08:00.756824 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:08:00.763012 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:08:00.784659 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:08:00.826666 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:08:00.938134 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:08:00.967641 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:08:01.011205 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:08:01.627818 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:08:01.684483 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:01.695906 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:01.732845 tst cs_paging_gprs_active.py: using LAC 34150 13:08:01.866969 tst cs_paging_gprs_active.py: using RAC 235 13:08:01.994381 tst cs_paging_gprs_active.py: using CellId 34150 13:08:02.129660 tst cs_paging_gprs_active.py: using BVCI 34151 13:08:02.269873 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.281659 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.293506 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.305149 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.316521 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.327545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.338753 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.350075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:02.362055 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:02.483305 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:02.602743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:08:02.815375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:03.132705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Launched 13:08:03.408260 run iperf3-srv_10.42.42.10(pid=24399): Launched 13:08:03.525777 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:08:03.735609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:04.052099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Launched 13:08:04.326336 run iperf3-srv_10.42.42.10(pid=24401): Launched 13:08:04.443211 tst cs_paging_gprs_active.py:38: start network... 13:08:04.652628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:05.138867 run create_hlr_db(pid=24402): Launched 13:08:05.268881 bus /gobi_6: Setting Powered False 13:08:06.331136 run create_hlr_db(pid=24402): Terminated: ok {rc=0} 13:08:06.787413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Launched 13:08:07.123418 run osmo-hlr_10.42.42.2(pid=24405): Launched 13:08:07.251291 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:07.828128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Launched 13:08:08.164047 run osmo-stp_10.42.42.5(pid=24408): Launched 13:08:08.291990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:08.868367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Launched 13:08:08.996173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:09.280450 run patchelf(pid=24411): Launched 13:08:09.466140 run osmo-stp_10.42.42.5(pid=24408): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] 13:08:09.607146 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-13_13:08:08.101503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:09.749451 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221213130808298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130808298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130808298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130808298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130808299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130808299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130808299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:09.892061 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-13_13:08:08.101503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:10.028739 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221213130808298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130808298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130808298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130808298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130808299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130808299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130808299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:10.190857 run patchelf(pid=24411): Terminating (SIGINT) 13:08:10.378144 run patchelf(pid=24411): Terminated: ok {rc=0} 13:08:10.513041 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24408): Process ended prematurely: osmo-stp_10.42.42.5(pid=24408) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] [trial-2390↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:08:10.523460 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:08:10.551962 run osmo-hlr_10.42.42.2(pid=24405): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24405)] 13:08:10.602873 run osmo-hlr_10.42.42.2(pid=24405): stdout: | (launched: 2022-12-13_13:08:07.060738) 13:08:10.655464 run osmo-hlr_10.42.42.2(pid=24405): stderr: | 20221213130807263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130807263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130807263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130807263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130807263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130807263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130807275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130807284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130807284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130807284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:10.708317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminating (SIGTERM) 13:08:10.750635 run iperf3-srv_10.42.42.10(pid=24399): Terminating (SIGTERM) 13:08:10.793358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminating (SIGTERM) 13:08:10.836096 run iperf3-srv_10.42.42.10(pid=24401): Terminating (SIGTERM) 13:08:10.878417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminating (SIGTERM) 13:08:10.920876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminating (SIGTERM) 13:08:10.963440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Terminating (SIGTERM) 13:08:11.006163 --- ParallelTerminationStrategy: PID 24398 died... 13:08:11.026635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminated: ok {rc=0} 13:08:11.073489 --- ParallelTerminationStrategy: PID 24399 died... 13:08:11.093384 run iperf3-srv_10.42.42.10(pid=24399): Terminated {rc=256} 13:08:11.139778 --- ParallelTerminationStrategy: PID 24400 died... 13:08:11.159917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminated: ok {rc=0} 13:08:11.206678 --- ParallelTerminationStrategy: PID 24401 died... 13:08:11.226634 run iperf3-srv_10.42.42.10(pid=24401): Terminated {rc=256} 13:08:11.273651 --- ParallelTerminationStrategy: PID 24404 died... 13:08:11.293673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminated: ok {rc=0} 13:08:11.340333 --- ParallelTerminationStrategy: PID 24407 died... 13:08:11.360458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminated: ok {rc=0} 13:08:11.407441 --- ParallelTerminationStrategy: PID 24410 died... 13:08:11.427525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Terminated: ok {rc=0} 13:08:11.517104 bus /gobi_0: Setting Powered False 13:08:12.617117 bus /gobi_0: Setting Powered False 13:08:13.731081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:08:14.883007 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:14.895262 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:14.933750 tst iperf3.py: using LAC 34151 13:08:15.059776 tst iperf3.py: using RAC 236 13:08:15.184730 tst iperf3.py: using CellId 34151 13:08:15.308811 tst iperf3.py: using BVCI 34152 13:08:15.423700 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.434673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.445454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.456096 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.467333 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.478602 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.489959 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.501098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:15.512394 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:15.637252 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:15.868779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:16.205602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24412): Launched 13:08:16.500894 run iperf3-srv_10.42.42.10(pid=24413): Launched 13:08:16.637581 tst iperf3.py:8: start network... 13:08:16.853612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:17.361621 run create_hlr_db(pid=24414): Launched 13:08:17.491635 bus /gobi_6: Setting Powered False 13:08:18.553193 run create_hlr_db(pid=24414): Terminated: ok {rc=0} 13:08:18.987644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Launched 13:08:19.301501 run osmo-hlr_10.42.42.2(pid=24417): Launched 13:08:19.421932 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:19.961971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Launched 13:08:20.274791 run osmo-stp_10.42.42.5(pid=24420): Launched 13:08:20.392037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:20.932032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Launched 13:08:21.050639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:21.314949 run patchelf(pid=24423): Launched 13:08:21.487808 run osmo-stp_10.42.42.5(pid=24420): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] 13:08:21.618997 run osmo-stp_10.42.42.5(pid=24420): stdout: | (launched: 2022-12-13_13:08:20.215476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:21.751698 run osmo-stp_10.42.42.5(pid=24420): stderr: | 20221213130820389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130820390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130820390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130820390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130820391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130820391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130820391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:21.884464 run osmo-stp_10.42.42.5(pid=24420): stdout: | (launched: 2022-12-13_13:08:20.215476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:22.011752 run osmo-stp_10.42.42.5(pid=24420): stderr: | 20221213130820389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130820390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130820390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130820390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130820391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130820391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130820391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:22.162236 run patchelf(pid=24423): Terminating (SIGINT) 13:08:22.337463 run patchelf(pid=24423): Terminated: ok {rc=0} 13:08:22.463336 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24420): Process ended prematurely: osmo-stp_10.42.42.5(pid=24420) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 13:08:22.472814 tst iperf3.py:8: Test FAILED (7.6 sec) 13:08:22.499918 run osmo-hlr_10.42.42.2(pid=24417): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24417)] 13:08:22.547688 run osmo-hlr_10.42.42.2(pid=24417): stdout: | (launched: 2022-12-13_13:08:19.242404) 13:08:22.597161 run osmo-hlr_10.42.42.2(pid=24417): stderr: | 20221213130819421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130819421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130819421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130819421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130819421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130819421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130819451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130819461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130819461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130819461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:22.646875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24412): Terminating (SIGTERM) 13:08:22.687554 run iperf3-srv_10.42.42.10(pid=24413): Terminating (SIGTERM) 13:08:22.727367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Terminating (SIGTERM) 13:08:22.767405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Terminating (SIGTERM) 13:08:22.807287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Terminating (SIGTERM) 13:08:22.847363 --- ParallelTerminationStrategy: PID 24412 died... 13:08:22.866627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24412): Terminated: ok {rc=0} 13:08:22.910904 --- ParallelTerminationStrategy: PID 24413 died... 13:08:22.929488 run iperf3-srv_10.42.42.10(pid=24413): Terminated {rc=256} 13:08:22.973350 --- ParallelTerminationStrategy: PID 24416 died... 13:08:22.992080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24416): Terminated: ok {rc=0} 13:08:23.036028 --- ParallelTerminationStrategy: PID 24419 died... 13:08:23.055115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24419): Terminated: ok {rc=0} 13:08:23.098934 --- ParallelTerminationStrategy: PID 24422 died... 13:08:23.117485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24422): Terminated: ok {rc=0} 13:08:23.203228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:08:24.351086 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.362601 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:24.401409 tst iperf3m4.py: using LAC 34152 13:08:24.534714 tst iperf3m4.py: using RAC 237 13:08:24.667337 tst iperf3m4.py: using CellId 34152 13:08:24.800257 tst iperf3m4.py: using BVCI 34153 13:08:24.922649 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.934201 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.945637 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.956886 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.968307 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.979736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:24.991425 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:25.002841 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:25.014453 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:25.134260 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:25.260266 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:25.380211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:25.501960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:25.728226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:26.067067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24424): Launched 13:08:26.360305 run iperf3-srv_10.42.42.10(pid=24425): Launched 13:08:26.486326 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:08:26.711403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:27.049252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24426): Launched 13:08:27.342492 run iperf3-srv_10.42.42.10(pid=24427): Launched 13:08:27.468536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:08:27.694236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:28.031638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24428): Launched 13:08:28.327108 run iperf3-srv_10.42.42.10(pid=24429): Launched 13:08:28.453436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:08:28.679037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:29.016447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24430): Launched 13:08:29.309401 run iperf3-srv_10.42.42.10(pid=24431): Launched 13:08:29.436528 tst iperf3m4.py:8: start network... 13:08:29.664103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:30.149735 run create_hlr_db(pid=24432): Launched 13:08:30.278695 bus /gobi_6: Setting Powered False 13:08:31.338515 run create_hlr_db(pid=24432): Terminated: ok {rc=0} 13:08:31.787201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24434): Launched 13:08:32.121925 run osmo-hlr_10.42.42.2(pid=24435): Launched 13:08:32.315288 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:32.893099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24437): Launched 13:08:33.228563 run osmo-stp_10.42.42.5(pid=24438): Launched 13:08:33.356846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:33.934347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24440): Launched 13:08:34.063660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:34.348342 run patchelf(pid=24441): Launched 13:08:34.533253 run osmo-stp_10.42.42.5(pid=24438): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24438)] 13:08:34.674018 run osmo-stp_10.42.42.5(pid=24438): stdout: | (launched: 2022-12-13_13:08:33.165896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:34.816391 run osmo-stp_10.42.42.5(pid=24438): stderr: | 20221213130833360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130833360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130833360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130833361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130833363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130833363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130833363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:34.959051 run osmo-stp_10.42.42.5(pid=24438): stdout: | (launched: 2022-12-13_13:08:33.165896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:35.095167 run osmo-stp_10.42.42.5(pid=24438): stderr: | 20221213130833360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130833360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130833360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130833361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130833363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130833363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130833363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:35.256879 run patchelf(pid=24441): Terminating (SIGINT) 13:08:35.445324 run patchelf(pid=24441): Terminated: ok {rc=0} 13:08:35.580144 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24438): Process ended prematurely: osmo-stp_10.42.42.5(pid=24438) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24438)] [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 13:08:35.590476 tst iperf3m4.py:8: Test FAILED (11.3 sec) 13:08:35.619382 run osmo-hlr_10.42.42.2(pid=24435): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24435)] 13:08:35.670207 run osmo-hlr_10.42.42.2(pid=24435): stdout: | (launched: 2022-12-13_13:08:32.058675) 13:08:35.722203 run osmo-hlr_10.42.42.2(pid=24435): stderr: | 20221213130832293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130832293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130832293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130832293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130832293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130832293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130832309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130832319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130832319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130832319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:35.775345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24424): Terminating (SIGTERM) 13:08:35.818839 run iperf3-srv_10.42.42.10(pid=24425): Terminating (SIGTERM) 13:08:35.861245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24426): Terminating (SIGTERM) 13:08:35.903539 run iperf3-srv_10.42.42.10(pid=24427): Terminating (SIGTERM) 13:08:35.946049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24428): Terminating (SIGTERM) 13:08:35.988209 run iperf3-srv_10.42.42.10(pid=24429): Terminating (SIGTERM) 13:08:36.030193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24430): Terminating (SIGTERM) 13:08:36.072793 run iperf3-srv_10.42.42.10(pid=24431): Terminating (SIGTERM) 13:08:36.114754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24434): Terminating (SIGTERM) 13:08:36.157569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24437): Terminating (SIGTERM) 13:08:36.199516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24440): Terminating (SIGTERM) 13:08:36.242215 --- ParallelTerminationStrategy: PID 24424 died... 13:08:36.262546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24424): Terminated: ok {rc=0} 13:08:36.309430 --- ParallelTerminationStrategy: PID 24425 died... 13:08:36.329376 run iperf3-srv_10.42.42.10(pid=24425): Terminated {rc=256} 13:08:36.375533 --- ParallelTerminationStrategy: PID 24426 died... 13:08:36.395382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24426): Terminated: ok {rc=0} 13:08:36.441705 --- ParallelTerminationStrategy: PID 24427 died... 13:08:36.461506 run iperf3-srv_10.42.42.10(pid=24427): Terminated {rc=256} 13:08:36.507625 --- ParallelTerminationStrategy: PID 24428 died... 13:08:36.527536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24428): Terminated: ok {rc=0} 13:08:36.574015 --- ParallelTerminationStrategy: PID 24429 died... 13:08:36.593855 run iperf3-srv_10.42.42.10(pid=24429): Terminated {rc=256} 13:08:36.640205 --- ParallelTerminationStrategy: PID 24430 died... 13:08:36.660181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24430): Terminated: ok {rc=0} 13:08:36.706591 --- ParallelTerminationStrategy: PID 24431 died... 13:08:36.726481 run iperf3-srv_10.42.42.10(pid=24431): Terminated {rc=256} 13:08:36.772780 --- ParallelTerminationStrategy: PID 24434 died... 13:08:36.793273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24434): Terminated: ok {rc=0} 13:08:36.839749 --- ParallelTerminationStrategy: PID 24437 died... 13:08:36.859796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24437): Terminated: ok {rc=0} 13:08:36.906474 --- ParallelTerminationStrategy: PID 24440 died... 13:08:36.926634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24440): Terminated: ok {rc=0} 13:08:37.015866 bus /gobi_4: Setting Powered False 13:08:38.115773 bus /gobi_4: Setting Powered False 13:08:39.232688 bus /gobi_1: Setting Powered False 13:08:40.331872 bus /gobi_1: Setting Powered False 13:08:41.449579 bus /gobi_0: Setting Powered False 13:08:42.549504 bus /gobi_0: Setting Powered False 13:08:43.667328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 13:08:44.770764 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:44.782809 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:44.821797 tst ping.py: using LAC 34153 13:08:44.952533 tst ping.py: using RAC 238 13:08:45.082889 tst ping.py: using CellId 34153 13:08:45.217421 tst ping.py: using BVCI 34154 13:08:45.338037 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.349363 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.360576 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.371772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.383148 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.394658 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.406381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:45.417795 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:45.539883 tst ping.py:19: start network... 13:08:45.746351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:46.232171 run create_hlr_db(pid=24443): Launched 13:08:46.394622 bus /gobi_6: Setting Powered False 13:08:47.482740 run create_hlr_db(pid=24443): Terminated: ok {rc=0} 13:08:47.975161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24514): Launched 13:08:48.365965 run osmo-hlr_10.42.42.2(pid=24560): Launched 13:08:48.643946 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:49.410731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24688): Launched 13:08:49.783376 run osmo-stp_10.42.42.5(pid=24718): Launched 13:08:50.048336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:50.696292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Launched 13:08:50.835523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:51.124259 run patchelf(pid=24722): Launched 13:08:51.315199 run osmo-stp_10.42.42.5(pid=24718): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] 13:08:51.445587 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-13_13:08:49.721595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:51.578487 run osmo-stp_10.42.42.5(pid=24718): stderr: | 20221213130849987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130849987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130849987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130849988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130849988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130849988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130849988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:51.712074 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-13_13:08:49.721595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:51.838812 run osmo-stp_10.42.42.5(pid=24718): stderr: | 20221213130849987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130849987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130849987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130849988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130849988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130849988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130849988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:51.995372 run patchelf(pid=24722): Terminating (SIGINT) 13:08:52.171006 run patchelf(pid=24722): Terminated: ok {rc=0} 13:08:52.296053 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 13:08:52.305710 tst ping.py:22: Test FAILED (7.5 sec) 13:08:52.333180 run osmo-hlr_10.42.42.2(pid=24560): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24560)] 13:08:52.382214 run osmo-hlr_10.42.42.2(pid=24560): stdout: | (launched: 2022-12-13_13:08:48.283908) 13:08:52.432463 run osmo-hlr_10.42.42.2(pid=24560): stderr: | 20221213130848694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130848694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130848694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130848694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130848694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130848694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130848721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130848738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130848738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130848738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:52.483314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24514): Terminating (SIGTERM) 13:08:52.524684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24688): Terminating (SIGTERM) 13:08:52.567867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Terminating (SIGTERM) 13:08:52.611382 --- ParallelTerminationStrategy: PID 24514 died... 13:08:52.631416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24514): Terminated: ok {rc=0} 13:08:52.679101 --- ParallelTerminationStrategy: PID 24688 died... 13:08:52.698674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24688): Terminated: ok {rc=0} 13:08:52.743932 --- ParallelTerminationStrategy: PID 24721 died... 13:08:52.763626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Terminated: ok {rc=0} 13:08:52.851908 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:08:53.942353 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:53.955154 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:53.995036 tst ping_idle_ping.py: using LAC 34154 13:08:54.119304 tst ping_idle_ping.py: using RAC 239 13:08:54.246967 tst ping_idle_ping.py: using CellId 34154 13:08:54.371103 tst ping_idle_ping.py: using BVCI 34155 13:08:54.487549 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.499559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.511299 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.523215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.535411 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.547893 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.560488 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:54.572833 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:54.704806 tst ping_idle_ping.py:24: start network... 13:08:54.918854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:55.416720 run create_hlr_db(pid=24725): Launched 13:08:55.582968 bus /gobi_6: Setting Powered False 13:08:56.646533 run create_hlr_db(pid=24725): Terminated: ok {rc=0} 13:08:57.098964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24727): Launched 13:08:57.434019 run osmo-hlr_10.42.42.2(pid=24728): Launched 13:08:57.685166 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:58.424091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24730): Launched 13:08:58.763742 run osmo-stp_10.42.42.5(pid=24731): Launched 13:08:59.003817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:59.735752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24733): Launched 13:08:59.871489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:00.149983 run patchelf(pid=24734): Launched 13:09:00.344182 run osmo-stp_10.42.42.5(pid=24731): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24731)] 13:09:00.481736 run osmo-stp_10.42.42.5(pid=24731): stdout: | (launched: 2022-12-13_13:08:58.700227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:00.619621 run osmo-stp_10.42.42.5(pid=24731): stderr: | 20221213130859044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130859044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130859045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130859046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130859046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130859046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130859046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:00.759208 run osmo-stp_10.42.42.5(pid=24731): stdout: | (launched: 2022-12-13_13:08:58.700227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:00.893386 run osmo-stp_10.42.42.5(pid=24731): stderr: | 20221213130859044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130859044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130859045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130859046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130859046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130859046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130859046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:01.062830 run patchelf(pid=24734): Terminating (SIGINT) 13:09:01.247819 run patchelf(pid=24734): Terminated: ok {rc=0} 13:09:01.401406 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24731): Process ended prematurely: osmo-stp_10.42.42.5(pid=24731) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24731)] [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 13:09:01.414115 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 13:09:01.447986 run osmo-hlr_10.42.42.2(pid=24728): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24728)] 13:09:01.505458 run osmo-hlr_10.42.42.2(pid=24728): stdout: | (launched: 2022-12-13_13:08:57.371215) 13:09:01.563719 run osmo-hlr_10.42.42.2(pid=24728): stderr: | 20221213130857728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130857728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130857728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130857728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130857728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130857728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130857747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130857755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130857755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130857755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:01.622478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24727): Terminating (SIGTERM) 13:09:01.672874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24730): Terminating (SIGTERM) 13:09:01.723803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24733): Terminating (SIGTERM) 13:09:01.774436 --- ParallelTerminationStrategy: PID 24727 died... 13:09:01.797167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24727): Terminated: ok {rc=0} 13:09:01.851877 --- ParallelTerminationStrategy: PID 24730 died... 13:09:01.874763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24730): Terminated: ok {rc=0} 13:09:01.927114 --- ParallelTerminationStrategy: PID 24733 died... 13:09:01.949314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24733): Terminated: ok {rc=0} 13:09:02.054334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:09:03.364418 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:03.372007 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:09:03.394999 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:09:03.440512 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:09:03.534570 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:09:03.557665 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:09:03.600138 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:09:04.197178 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:09:04.256867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.269769 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:04.331409 tst cs_paging_gprs_active.py: using LAC 34155 13:09:04.468037 tst cs_paging_gprs_active.py: using RAC 240 13:09:04.604149 tst cs_paging_gprs_active.py: using CellId 34155 13:09:04.739458 tst cs_paging_gprs_active.py: using BVCI 34156 13:09:04.866806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.879314 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.891715 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.904223 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.917539 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.931090 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.944551 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.957335 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:04.971770 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:05.103855 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:05.233182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:09:05.469383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:05.820550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24738): Launched 13:09:06.137346 run iperf3-srv_10.42.42.10(pid=24739): Launched 13:09:06.282028 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:09:06.517612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:06.869924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Launched 13:09:07.184884 run iperf3-srv_10.42.42.10(pid=24741): Launched 13:09:07.329961 tst cs_paging_gprs_active.py:38: start network... 13:09:07.564098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:08.104554 run create_hlr_db(pid=24742): Launched 13:09:08.275453 bus /gobi_6: Setting Powered False 13:09:09.343885 run create_hlr_db(pid=24742): Terminated: ok {rc=0} 13:09:09.803114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Launched 13:09:10.119823 run osmo-hlr_10.42.42.2(pid=24745): Launched 13:09:10.238906 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:10.783679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Launched 13:09:11.098710 run osmo-stp_10.42.42.5(pid=24748): Launched 13:09:11.220461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:11.765743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Launched 13:09:11.886710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:12.154720 run patchelf(pid=24751): Launched 13:09:12.328495 run osmo-stp_10.42.42.5(pid=24748): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] 13:09:12.460767 run osmo-stp_10.42.42.5(pid=24748): stdout: | (launched: 2022-12-13_13:09:11.039038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:12.594523 run osmo-stp_10.42.42.5(pid=24748): stderr: | 20221213130911212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130911213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130911213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130911213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130911214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130911214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130911214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:12.727913 run osmo-stp_10.42.42.5(pid=24748): stdout: | (launched: 2022-12-13_13:09:11.039038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:12.855569 run osmo-stp_10.42.42.5(pid=24748): stderr: | 20221213130911212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130911213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130911213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130911213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130911214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130911214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130911214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:13.006930 run patchelf(pid=24751): Terminating (SIGINT) 13:09:13.182880 run patchelf(pid=24751): Terminated: ok {rc=0} 13:09:13.309676 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24748): Process ended prematurely: osmo-stp_10.42.42.5(pid=24748) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:09:13.319098 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 13:09:13.346271 run osmo-hlr_10.42.42.2(pid=24745): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24745)] 13:09:13.393906 run osmo-hlr_10.42.42.2(pid=24745): stdout: | (launched: 2022-12-13_13:09:10.060539) 13:09:13.443050 run osmo-hlr_10.42.42.2(pid=24745): stderr: | 20221213130910241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130910241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130910242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130910242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130910242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130910242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130910255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130910264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130910265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130910265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:13.492714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24738): Terminating (SIGTERM) 13:09:13.532591 run iperf3-srv_10.42.42.10(pid=24739): Terminating (SIGTERM) 13:09:13.572225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Terminating (SIGTERM) 13:09:13.612055 run iperf3-srv_10.42.42.10(pid=24741): Terminating (SIGTERM) 13:09:13.651862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Terminating (SIGTERM) 13:09:13.691725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Terminating (SIGTERM) 13:09:13.731479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Terminating (SIGTERM) 13:09:13.771980 --- ParallelTerminationStrategy: PID 24738 died... 13:09:13.791127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24738): Terminated: ok {rc=0} 13:09:13.835180 --- ParallelTerminationStrategy: PID 24739 died... 13:09:13.853724 run iperf3-srv_10.42.42.10(pid=24739): Terminated {rc=256} 13:09:13.897504 --- ParallelTerminationStrategy: PID 24740 died... 13:09:13.916002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Terminated: ok {rc=0} 13:09:13.959579 --- ParallelTerminationStrategy: PID 24741 died... 13:09:13.978088 run iperf3-srv_10.42.42.10(pid=24741): Terminated {rc=256} 13:09:14.021925 --- ParallelTerminationStrategy: PID 24744 died... 13:09:14.040538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Terminated: ok {rc=0} 13:09:14.084324 --- ParallelTerminationStrategy: PID 24747 died... 13:09:14.103005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Terminated: ok {rc=0} 13:09:14.146729 --- ParallelTerminationStrategy: PID 24750 died... 13:09:14.165374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Terminated: ok {rc=0} 13:09:14.251643 bus /gobi_0: Setting Powered False 13:09:15.351018 bus /gobi_0: Setting Powered False 13:09:16.466775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:09:17.617688 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:17.629833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:17.691000 tst iperf3.py: using LAC 34156 13:09:17.822516 tst iperf3.py: using RAC 241 13:09:17.954627 tst iperf3.py: using CellId 34156 13:09:18.078844 tst iperf3.py: using BVCI 34157 13:09:18.194435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.205731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.217104 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.227920 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.238928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.250008 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.261199 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.272100 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:18.283224 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:18.404051 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:18.631564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:18.969312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Launched 13:09:19.262235 run iperf3-srv_10.42.42.10(pid=24753): Launched 13:09:19.390658 tst iperf3.py:8: start network... 13:09:19.616081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:20.134910 run create_hlr_db(pid=24754): Launched 13:09:20.262925 bus /gobi_6: Setting Powered False 13:09:21.328799 run create_hlr_db(pid=24754): Terminated: ok {rc=0} 13:09:21.775581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Launched 13:09:22.091741 run osmo-hlr_10.42.42.2(pid=24757): Launched 13:09:22.210757 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:22.751571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Launched 13:09:23.068430 run osmo-stp_10.42.42.5(pid=24760): Launched 13:09:23.188098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:23.726911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24762): Launched 13:09:23.846862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:24.112361 run patchelf(pid=24763): Launched 13:09:24.285450 run osmo-stp_10.42.42.5(pid=24760): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] 13:09:24.417640 run osmo-stp_10.42.42.5(pid=24760): stdout: | (launched: 2022-12-13_13:09:23.008661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:24.551325 run osmo-stp_10.42.42.5(pid=24760): stderr: | 20221213130923181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130923181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130923181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130923182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130923184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130923184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130923184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:24.686429 run osmo-stp_10.42.42.5(pid=24760): stdout: | (launched: 2022-12-13_13:09:23.008661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:24.814264 run osmo-stp_10.42.42.5(pid=24760): stderr: | 20221213130923181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130923181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130923181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130923182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130923184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130923184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130923184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:24.965525 run patchelf(pid=24763): Terminating (SIGINT) 13:09:25.141172 run patchelf(pid=24763): Terminated: ok {rc=0} 13:09:25.267497 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24760): Process ended prematurely: osmo-stp_10.42.42.5(pid=24760) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 13:09:25.277045 tst iperf3.py:8: Test FAILED (7.7 sec) 13:09:25.304311 run osmo-hlr_10.42.42.2(pid=24757): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24757)] 13:09:25.352548 run osmo-hlr_10.42.42.2(pid=24757): stdout: | (launched: 2022-12-13_13:09:22.032410) 13:09:25.402513 run osmo-hlr_10.42.42.2(pid=24757): stderr: | 20221213130922212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130922212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130922212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130922212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130922212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130922212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130922228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130922239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130922239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130922239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:25.452574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminating (SIGTERM) 13:09:25.493143 run iperf3-srv_10.42.42.10(pid=24753): Terminating (SIGTERM) 13:09:25.533354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Terminating (SIGTERM) 13:09:25.573928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Terminating (SIGTERM) 13:09:25.614290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24762): Terminating (SIGTERM) 13:09:25.654844 --- ParallelTerminationStrategy: PID 24752 died... 13:09:25.674446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminated: ok {rc=0} 13:09:25.719114 --- ParallelTerminationStrategy: PID 24753 died... 13:09:25.738235 run iperf3-srv_10.42.42.10(pid=24753): Terminated {rc=256} 13:09:25.782658 --- ParallelTerminationStrategy: PID 24756 died... 13:09:25.801871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Terminated: ok {rc=0} 13:09:25.846703 --- ParallelTerminationStrategy: PID 24759 died... 13:09:25.865979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Terminated: ok {rc=0} 13:09:25.910533 --- ParallelTerminationStrategy: PID 24762 died... 13:09:25.929624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24762): Terminated: ok {rc=0} 13:09:26.016659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:09:27.166269 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.178061 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:27.236498 tst iperf3m4.py: using LAC 34157 13:09:27.359847 tst iperf3m4.py: using RAC 242 13:09:27.484110 tst iperf3m4.py: using CellId 34157 13:09:27.608522 tst iperf3m4.py: using BVCI 34158 13:09:27.724426 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.735471 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.746255 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.756912 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.767760 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.778684 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.789790 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.800607 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:27.811662 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:27.931117 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:28.054557 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:28.173437 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:28.297213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:28.524355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:28.861352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24764): Launched 13:09:29.155589 run iperf3-srv_10.42.42.10(pid=24765): Launched 13:09:29.281076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:09:29.506455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:29.842119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24766): Launched 13:09:30.135787 run iperf3-srv_10.42.42.10(pid=24767): Launched 13:09:30.260875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:09:30.485931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:30.821534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Launched 13:09:31.136896 run iperf3-srv_10.42.42.10(pid=24769): Launched 13:09:31.271235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:09:31.485944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:31.811777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Launched 13:09:32.104519 run iperf3-srv_10.42.42.10(pid=24771): Launched 13:09:32.237731 tst iperf3m4.py:8: start network... 13:09:32.447234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:32.936854 run create_hlr_db(pid=24772): Launched 13:09:33.063982 bus /gobi_6: Setting Powered False 13:09:34.125323 run create_hlr_db(pid=24772): Terminated: ok {rc=0} 13:09:34.561557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Launched 13:09:34.877705 run osmo-hlr_10.42.42.2(pid=24775): Launched 13:09:34.999006 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:35.537201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Launched 13:09:35.851111 run osmo-stp_10.42.42.5(pid=24778): Launched 13:09:35.970980 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:36.510389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Launched 13:09:36.629552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:36.894674 run patchelf(pid=24781): Launched 13:09:37.067789 run osmo-stp_10.42.42.5(pid=24778): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] 13:09:37.200052 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-13_13:09:35.791069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:37.333771 run osmo-stp_10.42.42.5(pid=24778): stderr: | 20221213130935966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130935967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130935967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130935967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130935968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130935968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130935968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:37.467078 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-13_13:09:35.791069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:37.594622 run osmo-stp_10.42.42.5(pid=24778): stderr: | 20221213130935966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130935967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130935967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130935967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130935968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130935968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130935968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:37.746193 run patchelf(pid=24781): Terminating (SIGINT) 13:09:37.922535 run patchelf(pid=24781): Terminated: ok {rc=0} 13:09:38.049751 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24778): Process ended prematurely: osmo-stp_10.42.42.5(pid=24778) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:09:38.059172 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:09:38.086623 run osmo-hlr_10.42.42.2(pid=24775): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24775)] 13:09:38.134854 run osmo-hlr_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-13_13:09:34.818020) 13:09:38.184617 run osmo-hlr_10.42.42.2(pid=24775): stderr: | 20221213130935001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130935001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130935001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130935001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130935001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130935002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130935014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130935023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130935023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130935023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:38.234651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24764): Terminating (SIGTERM) 13:09:38.275637 run iperf3-srv_10.42.42.10(pid=24765): Terminating (SIGTERM) 13:09:38.316311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24766): Terminating (SIGTERM) 13:09:38.357176 run iperf3-srv_10.42.42.10(pid=24767): Terminating (SIGTERM) 13:09:38.397949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminating (SIGTERM) 13:09:38.438362 run iperf3-srv_10.42.42.10(pid=24769): Terminating (SIGTERM) 13:09:38.478359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminating (SIGTERM) 13:09:38.518496 run iperf3-srv_10.42.42.10(pid=24771): Terminating (SIGTERM) 13:09:38.558547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminating (SIGTERM) 13:09:38.598827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminating (SIGTERM) 13:09:38.639106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminating (SIGTERM) 13:09:38.679585 --- ParallelTerminationStrategy: PID 24764 died... 13:09:38.699113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24764): Terminated: ok {rc=0} 13:09:38.743684 --- ParallelTerminationStrategy: PID 24765 died... 13:09:38.762620 run iperf3-srv_10.42.42.10(pid=24765): Terminated {rc=256} 13:09:38.806938 --- ParallelTerminationStrategy: PID 24766 died... 13:09:38.826158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24766): Terminated: ok {rc=0} 13:09:38.870517 --- ParallelTerminationStrategy: PID 24767 died... 13:09:38.889342 run iperf3-srv_10.42.42.10(pid=24767): Terminated {rc=256} 13:09:38.933600 --- ParallelTerminationStrategy: PID 24768 died... 13:09:38.952498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminated: ok {rc=0} 13:09:38.996789 --- ParallelTerminationStrategy: PID 24769 died... 13:09:39.015754 run iperf3-srv_10.42.42.10(pid=24769): Terminated {rc=256} 13:09:39.060110 --- ParallelTerminationStrategy: PID 24770 died... 13:09:39.079048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminated: ok {rc=0} 13:09:39.123452 --- ParallelTerminationStrategy: PID 24771 died... 13:09:39.142503 run iperf3-srv_10.42.42.10(pid=24771): Terminated {rc=256} 13:09:39.186838 --- ParallelTerminationStrategy: PID 24774 died... 13:09:39.206086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminated: ok {rc=0} 13:09:39.250542 --- ParallelTerminationStrategy: PID 24777 died... 13:09:39.269573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminated: ok {rc=0} 13:09:39.313798 --- ParallelTerminationStrategy: PID 24780 died... 13:09:39.332569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminated: ok {rc=0} 13:09:39.419685 bus /gobi_4: Setting Powered False 13:09:40.521089 bus /gobi_4: Setting Powered False 13:09:41.638062 bus /gobi_1: Setting Powered False 13:09:42.740016 bus /gobi_1: Setting Powered False 13:09:43.859104 bus /gobi_0: Setting Powered False 13:09:44.958675 bus /gobi_0: Setting Powered False 13:09:46.073225 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:09:47.188886 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.203925 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:47.264057 tst ping.py: using LAC 34158 13:09:47.392863 tst ping.py: using RAC 243 13:09:47.523397 tst ping.py: using CellId 34158 13:09:47.652279 tst ping.py: using BVCI 34159 13:09:47.767542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.778699 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.789650 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.800693 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.812015 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.823245 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.834635 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:47.845950 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:47.964150 tst ping.py:19: start network... 13:09:48.170851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:48.649275 run create_hlr_db(pid=24782): Launched 13:09:48.773517 bus /gobi_6: Setting Powered False 13:09:49.837212 run create_hlr_db(pid=24782): Terminated: ok {rc=0} 13:09:50.296581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Launched 13:09:50.626941 run osmo-hlr_10.42.42.2(pid=24785): Launched 13:09:50.751704 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:51.331946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Launched 13:09:51.663237 run osmo-stp_10.42.42.5(pid=24788): Launched 13:09:51.788346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:52.361688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Launched 13:09:52.478900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:52.739442 run patchelf(pid=24791): Launched 13:09:52.909549 run osmo-stp_10.42.42.5(pid=24788): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] 13:09:53.039079 run osmo-stp_10.42.42.5(pid=24788): stdout: | (launched: 2022-12-13_13:09:51.601345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:53.170955 run osmo-stp_10.42.42.5(pid=24788): stderr: | 20221213130951795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130951795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130951795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130951796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130951796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130951796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130951796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:53.302228 run osmo-stp_10.42.42.5(pid=24788): stdout: | (launched: 2022-12-13_13:09:51.601345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:53.427292 run osmo-stp_10.42.42.5(pid=24788): stderr: | 20221213130951795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130951795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130951795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130951796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130951796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130951796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130951796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:53.575399 run patchelf(pid=24791): Terminating (SIGINT) 13:09:53.747208 run patchelf(pid=24791): Terminated: ok {rc=0} 13:09:53.870971 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24788): Process ended prematurely: osmo-stp_10.42.42.5(pid=24788) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 13:09:53.879794 tst ping.py:22: Test FAILED (6.7 sec) 13:09:53.906487 run osmo-hlr_10.42.42.2(pid=24785): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24785)] 13:09:53.953975 run osmo-hlr_10.42.42.2(pid=24785): stdout: | (launched: 2022-12-13_13:09:50.565198) 13:09:54.003334 run osmo-hlr_10.42.42.2(pid=24785): stderr: | 20221213130950765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130950765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130950765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130950765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130950765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130950765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130950779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130950789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130950789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130950789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:54.052662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Terminating (SIGTERM) 13:09:54.093426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Terminating (SIGTERM) 13:09:54.133316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Terminating (SIGTERM) 13:09:54.173438 --- ParallelTerminationStrategy: PID 24784 died... 13:09:54.192786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Terminated: ok {rc=0} 13:09:54.237081 --- ParallelTerminationStrategy: PID 24787 died... 13:09:54.255982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Terminated: ok {rc=0} 13:09:54.299607 --- ParallelTerminationStrategy: PID 24790 died... 13:09:54.318320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Terminated: ok {rc=0} 13:09:54.404310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:09:55.493425 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:55.505569 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:55.565955 tst ping_idle_ping.py: using LAC 34159 13:09:55.687013 tst ping_idle_ping.py: using RAC 244 13:09:55.806759 tst ping_idle_ping.py: using CellId 34159 13:09:55.926816 tst ping_idle_ping.py: using BVCI 34160 13:09:56.038617 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.049677 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.060444 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.071108 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.082114 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.092708 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.103714 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:56.114544 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:56.235343 tst ping_idle_ping.py:24: start network... 13:09:56.457384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:56.969437 run create_hlr_db(pid=24792): Launched 13:09:57.095528 bus /gobi_6: Setting Powered False 13:09:58.161192 run create_hlr_db(pid=24792): Terminated: ok {rc=0} 13:09:58.603486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24794): Launched 13:09:58.915054 run osmo-hlr_10.42.42.2(pid=24795): Launched 13:09:59.032628 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:59.566058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24797): Launched 13:09:59.874878 run osmo-stp_10.42.42.5(pid=24798): Launched 13:09:59.991700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:00.526896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24800): Launched 13:10:00.644362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:00.917617 run patchelf(pid=24801): Launched 13:10:01.100445 run osmo-stp_10.42.42.5(pid=24798): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24798)] 13:10:01.235166 run osmo-stp_10.42.42.5(pid=24798): stdout: | (launched: 2022-12-13_13:09:59.816339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:01.371488 run osmo-stp_10.42.42.5(pid=24798): stderr: | 20221213130959989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130959989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130959989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130959990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130959992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130959992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130959992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:01.514660 run osmo-stp_10.42.42.5(pid=24798): stdout: | (launched: 2022-12-13_13:09:59.816339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:01.643583 run osmo-stp_10.42.42.5(pid=24798): stderr: | 20221213130959989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213130959989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213130959989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213130959990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213130959992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213130959992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213130959992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:01.796326 run patchelf(pid=24801): Terminating (SIGINT) 13:10:01.973094 run patchelf(pid=24801): Terminated: ok {rc=0} 13:10:02.100469 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24798): Process ended prematurely: osmo-stp_10.42.42.5(pid=24798) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24798)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:10:02.110232 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:10:02.138704 run osmo-hlr_10.42.42.2(pid=24795): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24795)] 13:10:02.188181 run osmo-hlr_10.42.42.2(pid=24795): stdout: | (launched: 2022-12-13_13:09:58.856250) 13:10:02.239136 run osmo-hlr_10.42.42.2(pid=24795): stderr: | 20221213130959034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213130959034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213130959034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213130959034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213130959035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213130959035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213130959047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213130959055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213130959055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213130959055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:02.290002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24794): Terminating (SIGTERM) 13:10:02.330953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24797): Terminating (SIGTERM) 13:10:02.371440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24800): Terminating (SIGTERM) 13:10:02.412184 --- ParallelTerminationStrategy: PID 24794 died... 13:10:02.431435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24794): Terminated: ok {rc=0} 13:10:02.475899 --- ParallelTerminationStrategy: PID 24797 died... 13:10:02.494717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24797): Terminated: ok {rc=0} 13:10:02.539085 --- ParallelTerminationStrategy: PID 24800 died... 13:10:02.557856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24800): Terminated: ok {rc=0} 13:10:02.644449 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:10:03.937819 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:03.943805 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:10:03.964487 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:10:04.002878 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:10:04.090143 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:10:04.110999 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:10:04.149918 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:10:04.746809 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:10:04.802962 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:04.814469 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:04.877821 tst cs_paging_gprs_active.py: using LAC 34160 13:10:05.011634 tst cs_paging_gprs_active.py: using RAC 245 13:10:05.142807 tst cs_paging_gprs_active.py: using CellId 34160 13:10:05.273638 tst cs_paging_gprs_active.py: using BVCI 34161 13:10:05.396673 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.408119 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.419347 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.430546 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.441964 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.453560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.465181 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.476519 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:05.488319 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:05.608205 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:05.733111 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:10:05.960429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:06.299441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Launched 13:10:06.596019 run iperf3-srv_10.42.42.10(pid=24811): Launched 13:10:06.722014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:10:06.947477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:07.284724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Launched 13:10:07.578047 run iperf3-srv_10.42.42.10(pid=24813): Launched 13:10:07.706192 tst cs_paging_gprs_active.py:38: start network... 13:10:07.931624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:08.454647 run create_hlr_db(pid=24814): Launched 13:10:08.584118 bus /gobi_6: Setting Powered False 13:10:09.650163 run create_hlr_db(pid=24814): Terminated: ok {rc=0} 13:10:10.098444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Launched 13:10:10.415009 run osmo-hlr_10.42.42.2(pid=24817): Launched 13:10:10.535344 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:11.092298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Launched 13:10:11.407872 run osmo-stp_10.42.42.5(pid=24820): Launched 13:10:11.527434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:12.070611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Launched 13:10:12.190356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:12.458266 run patchelf(pid=24823): Launched 13:10:12.632363 run osmo-stp_10.42.42.5(pid=24820): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] 13:10:12.764327 run osmo-stp_10.42.42.5(pid=24820): stdout: | (launched: 2022-12-13_13:10:11.348443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:12.897862 run osmo-stp_10.42.42.5(pid=24820): stderr: | 20221213131011523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131011523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131011523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131011523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131011524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131011524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131011524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:13.031113 run osmo-stp_10.42.42.5(pid=24820): stdout: | (launched: 2022-12-13_13:10:11.348443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:13.158744 run osmo-stp_10.42.42.5(pid=24820): stderr: | 20221213131011523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131011523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131011523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131011523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131011524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131011524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131011524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:13.310356 run patchelf(pid=24823): Terminating (SIGINT) 13:10:13.486054 run patchelf(pid=24823): Terminated: ok {rc=0} 13:10:13.612832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24820): Process ended prematurely: osmo-stp_10.42.42.5(pid=24820) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:10:13.622416 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:10:13.649519 run osmo-hlr_10.42.42.2(pid=24817): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24817)] 13:10:13.697720 run osmo-hlr_10.42.42.2(pid=24817): stdout: | (launched: 2022-12-13_13:10:10.355660) 13:10:13.747404 run osmo-hlr_10.42.42.2(pid=24817): stderr: | 20221213131010537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131010537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131010538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131010538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131010538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131010538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131010551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131010562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131010562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131010562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:13.797456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Terminating (SIGTERM) 13:10:13.837926 run iperf3-srv_10.42.42.10(pid=24811): Terminating (SIGTERM) 13:10:13.878176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Terminating (SIGTERM) 13:10:13.918661 run iperf3-srv_10.42.42.10(pid=24813): Terminating (SIGTERM) 13:10:13.958673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Terminating (SIGTERM) 13:10:13.998825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Terminating (SIGTERM) 13:10:14.038967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Terminating (SIGTERM) 13:10:14.079363 --- ParallelTerminationStrategy: PID 24810 died... 13:10:14.098766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24810): Terminated: ok {rc=0} 13:10:14.143172 --- ParallelTerminationStrategy: PID 24811 died... 13:10:14.161890 run iperf3-srv_10.42.42.10(pid=24811): Terminated {rc=256} 13:10:14.205970 --- ParallelTerminationStrategy: PID 24812 died... 13:10:14.225184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24812): Terminated: ok {rc=0} 13:10:14.269867 --- ParallelTerminationStrategy: PID 24813 died... 13:10:14.288669 run iperf3-srv_10.42.42.10(pid=24813): Terminated {rc=256} 13:10:14.333042 --- ParallelTerminationStrategy: PID 24816 died... 13:10:14.351909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24816): Terminated: ok {rc=0} 13:10:14.396174 --- ParallelTerminationStrategy: PID 24819 died... 13:10:14.414985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24819): Terminated: ok {rc=0} 13:10:14.459082 --- ParallelTerminationStrategy: PID 24822 died... 13:10:14.477953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24822): Terminated: ok {rc=0} 13:10:14.564401 bus /gobi_0: Setting Powered False 13:10:15.665468 bus /gobi_0: Setting Powered False 13:10:16.778125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:10:17.923490 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:17.935042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:17.994664 tst iperf3.py: using LAC 34161 13:10:18.119075 tst iperf3.py: using RAC 246 13:10:18.249206 tst iperf3.py: using CellId 34161 13:10:18.374713 tst iperf3.py: using BVCI 34162 13:10:18.489424 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.500320 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.511066 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.521869 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.532898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.543622 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.554453 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.565073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:18.575964 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:18.691972 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:18.902964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:19.219841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24824): Launched 13:10:19.496070 run iperf3-srv_10.42.42.10(pid=24825): Launched 13:10:19.614241 tst iperf3.py:8: start network... 13:10:19.824315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:20.313428 run create_hlr_db(pid=24826): Launched 13:10:20.442633 bus /gobi_6: Setting Powered False 13:10:21.505363 run create_hlr_db(pid=24826): Terminated: ok {rc=0} 13:10:21.963264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24828): Launched 13:10:22.303077 run osmo-hlr_10.42.42.2(pid=24829): Launched 13:10:22.432418 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:23.014829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24831): Launched 13:10:23.353434 run osmo-stp_10.42.42.5(pid=24832): Launched 13:10:23.482755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:24.065141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24834): Launched 13:10:24.193417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:24.480008 run patchelf(pid=24835): Launched 13:10:24.666150 run osmo-stp_10.42.42.5(pid=24832): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24832)] 13:10:24.807821 run osmo-stp_10.42.42.5(pid=24832): stdout: | (launched: 2022-12-13_13:10:23.289768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:24.951283 run osmo-stp_10.42.42.5(pid=24832): stderr: | 20221213131023485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131023485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131023485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131023486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131023486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131023486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131023486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:25.094533 run osmo-stp_10.42.42.5(pid=24832): stdout: | (launched: 2022-12-13_13:10:23.289768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:25.231727 run osmo-stp_10.42.42.5(pid=24832): stderr: | 20221213131023485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131023485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131023485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131023486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131023486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131023486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131023486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:25.395243 run patchelf(pid=24835): Terminating (SIGINT) 13:10:25.583560 run patchelf(pid=24835): Terminated: ok {rc=0} 13:10:25.719253 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24832): Process ended prematurely: osmo-stp_10.42.42.5(pid=24832) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24832)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 13:10:25.729618 tst iperf3.py:8: Test FAILED (7.8 sec) 13:10:25.758194 run osmo-hlr_10.42.42.2(pid=24829): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24829)] 13:10:25.809504 run osmo-hlr_10.42.42.2(pid=24829): stdout: | (launched: 2022-12-13_13:10:22.239765) 13:10:25.862657 run osmo-hlr_10.42.42.2(pid=24829): stderr: | 20221213131022441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131022441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131022441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131022441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131022441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131022441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131022454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131022463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131022463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131022463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:25.915827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24824): Terminating (SIGTERM) 13:10:25.958330 run iperf3-srv_10.42.42.10(pid=24825): Terminating (SIGTERM) 13:10:26.002422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24828): Terminating (SIGTERM) 13:10:26.045412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24831): Terminating (SIGTERM) 13:10:26.087896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24834): Terminating (SIGTERM) 13:10:26.130662 --- ParallelTerminationStrategy: PID 24824 died... 13:10:26.151261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24824): Terminated: ok {rc=0} 13:10:26.198511 --- ParallelTerminationStrategy: PID 24825 died... 13:10:26.218533 run iperf3-srv_10.42.42.10(pid=24825): Terminated {rc=256} 13:10:26.265426 --- ParallelTerminationStrategy: PID 24828 died... 13:10:26.285571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24828): Terminated: ok {rc=0} 13:10:26.332744 --- ParallelTerminationStrategy: PID 24831 died... 13:10:26.352910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24831): Terminated: ok {rc=0} 13:10:26.400017 --- ParallelTerminationStrategy: PID 24834 died... 13:10:26.420309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24834): Terminated: ok {rc=0} 13:10:26.510125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:10:27.663912 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:27.676171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:27.737342 tst iperf3m4.py: using LAC 34162 13:10:27.869372 tst iperf3m4.py: using RAC 247 13:10:27.999863 tst iperf3m4.py: using CellId 34162 13:10:28.134054 tst iperf3m4.py: using BVCI 34163 13:10:28.256734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.268302 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.279579 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.290893 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.302979 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.315131 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.327671 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.340272 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:28.353156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:28.479802 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:28.602658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:28.726282 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:28.848663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:29.074456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:29.411198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24836): Launched 13:10:29.703374 run iperf3-srv_10.42.42.10(pid=24837): Launched 13:10:29.831475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:10:30.056673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:30.394478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24838): Launched 13:10:30.686216 run iperf3-srv_10.42.42.10(pid=24839): Launched 13:10:30.813916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:10:31.055245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:31.384906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24840): Launched 13:10:31.686054 run iperf3-srv_10.42.42.10(pid=24841): Launched 13:10:31.830744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:10:32.102720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:32.434157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24842): Launched 13:10:32.709269 run iperf3-srv_10.42.42.10(pid=24843): Launched 13:10:32.826671 tst iperf3m4.py:8: start network... 13:10:33.035472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:33.519390 run create_hlr_db(pid=24844): Launched 13:10:33.646716 bus /gobi_6: Setting Powered False 13:10:34.707959 run create_hlr_db(pid=24844): Terminated: ok {rc=0} 13:10:35.143822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24846): Launched 13:10:35.459162 run osmo-hlr_10.42.42.2(pid=24847): Launched 13:10:35.578364 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:36.143805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24849): Launched 13:10:36.461150 run osmo-stp_10.42.42.5(pid=24850): Launched 13:10:36.580744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:37.121663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24852): Launched 13:10:37.240999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:37.506455 run patchelf(pid=24853): Launched 13:10:37.681683 run osmo-stp_10.42.42.5(pid=24850): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24850)] 13:10:37.813469 run osmo-stp_10.42.42.5(pid=24850): stdout: | (launched: 2022-12-13_13:10:36.401239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:37.947414 run osmo-stp_10.42.42.5(pid=24850): stderr: | 20221213131036576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131036577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131036577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131036577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131036578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131036578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131036578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:38.081683 run osmo-stp_10.42.42.5(pid=24850): stdout: | (launched: 2022-12-13_13:10:36.401239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:38.209721 run osmo-stp_10.42.42.5(pid=24850): stderr: | 20221213131036576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131036577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131036577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131036577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131036578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131036578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131036578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:38.361818 run patchelf(pid=24853): Terminating (SIGINT) 13:10:38.538303 run patchelf(pid=24853): Terminated: ok {rc=0} 13:10:38.664858 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24850): Process ended prematurely: osmo-stp_10.42.42.5(pid=24850) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24850)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:10:38.674515 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:10:38.701809 run osmo-hlr_10.42.42.2(pid=24847): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24847)] 13:10:38.749197 run osmo-hlr_10.42.42.2(pid=24847): stdout: | (launched: 2022-12-13_13:10:35.399247) 13:10:38.798141 run osmo-hlr_10.42.42.2(pid=24847): stderr: | 20221213131035579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131035579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131035579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131035579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131035579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131035579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131035591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131035601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131035602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131035602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:38.847609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24836): Terminating (SIGTERM) 13:10:38.887619 run iperf3-srv_10.42.42.10(pid=24837): Terminating (SIGTERM) 13:10:38.927818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24838): Terminating (SIGTERM) 13:10:38.967985 run iperf3-srv_10.42.42.10(pid=24839): Terminating (SIGTERM) 13:10:39.008077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24840): Terminating (SIGTERM) 13:10:39.048144 run iperf3-srv_10.42.42.10(pid=24841): Terminating (SIGTERM) 13:10:39.088080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24842): Terminating (SIGTERM) 13:10:39.128220 run iperf3-srv_10.42.42.10(pid=24843): Terminating (SIGTERM) 13:10:39.168070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24846): Terminating (SIGTERM) 13:10:39.207918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24849): Terminating (SIGTERM) 13:10:39.247789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24852): Terminating (SIGTERM) 13:10:39.288058 --- ParallelTerminationStrategy: PID 24836 died... 13:10:39.307281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24836): Terminated: ok {rc=0} 13:10:39.351535 --- ParallelTerminationStrategy: PID 24837 died... 13:10:39.370239 run iperf3-srv_10.42.42.10(pid=24837): Terminated {rc=256} 13:10:39.414271 --- ParallelTerminationStrategy: PID 24838 died... 13:10:39.433153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24838): Terminated: ok {rc=0} 13:10:39.477372 --- ParallelTerminationStrategy: PID 24839 died... 13:10:39.496047 run iperf3-srv_10.42.42.10(pid=24839): Terminated {rc=256} 13:10:39.540089 --- ParallelTerminationStrategy: PID 24840 died... 13:10:39.558751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24840): Terminated: ok {rc=0} 13:10:39.602658 --- ParallelTerminationStrategy: PID 24841 died... 13:10:39.621290 run iperf3-srv_10.42.42.10(pid=24841): Terminated {rc=256} 13:10:39.665260 --- ParallelTerminationStrategy: PID 24842 died... 13:10:39.683774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24842): Terminated: ok {rc=0} 13:10:39.727864 --- ParallelTerminationStrategy: PID 24843 died... 13:10:39.746640 run iperf3-srv_10.42.42.10(pid=24843): Terminated {rc=256} 13:10:39.790480 --- ParallelTerminationStrategy: PID 24846 died... 13:10:39.809291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24846): Terminated: ok {rc=0} 13:10:39.853258 --- ParallelTerminationStrategy: PID 24849 died... 13:10:39.871817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24849): Terminated: ok {rc=0} 13:10:39.915952 --- ParallelTerminationStrategy: PID 24852 died... 13:10:39.934710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24852): Terminated: ok {rc=0} 13:10:40.020563 bus /gobi_4: Setting Powered False 13:10:41.121879 bus /gobi_4: Setting Powered False 13:10:42.241863 bus /gobi_1: Setting Powered False 13:10:43.340730 bus /gobi_1: Setting Powered False 13:10:44.455768 bus /gobi_0: Setting Powered False 13:10:45.555077 bus /gobi_0: Setting Powered False 13:10:46.671569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:10:47.775792 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:47.787387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:47.845647 tst ping.py: using LAC 34163 13:10:47.969389 tst ping.py: using RAC 248 13:10:48.092424 tst ping.py: using CellId 34163 13:10:48.215508 tst ping.py: using BVCI 34164 13:10:48.329134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.340149 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.350974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.361798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.372441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.383073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.393972 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:48.404646 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:48.526387 tst ping.py:19: start network... 13:10:48.747352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:49.257407 run create_hlr_db(pid=24854): Launched 13:10:49.384709 bus /gobi_6: Setting Powered False 13:10:50.450024 run create_hlr_db(pid=24854): Terminated: ok {rc=0} 13:10:50.891353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24857): Launched 13:10:51.201603 run osmo-hlr_10.42.42.2(pid=24858): Launched 13:10:51.318587 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:51.857392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24861): Launched 13:10:52.193191 run osmo-stp_10.42.42.5(pid=24863): Launched 13:10:52.317953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:52.886603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24865): Launched 13:10:53.012441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:53.292004 run patchelf(pid=24866): Launched 13:10:53.475303 run osmo-stp_10.42.42.5(pid=24863): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24863)] 13:10:53.614480 run osmo-stp_10.42.42.5(pid=24863): stdout: | (launched: 2022-12-13_13:10:52.130980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:53.755654 run osmo-stp_10.42.42.5(pid=24863): stderr: | 20221213131052329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131052329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131052329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131052330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131052330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131052330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131052330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:53.896706 run osmo-stp_10.42.42.5(pid=24863): stdout: | (launched: 2022-12-13_13:10:52.130980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:54.031593 run osmo-stp_10.42.42.5(pid=24863): stderr: | 20221213131052329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131052329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131052329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131052330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131052330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131052330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131052330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:54.191355 run patchelf(pid=24866): Terminating (SIGINT) 13:10:54.376422 run patchelf(pid=24866): Terminated: ok {rc=0} 13:10:54.509728 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24863): Process ended prematurely: osmo-stp_10.42.42.5(pid=24863) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24863)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 13:10:54.519359 tst ping.py:22: Test FAILED (6.7 sec) 13:10:54.547790 run osmo-hlr_10.42.42.2(pid=24858): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24858)] 13:10:54.599263 run osmo-hlr_10.42.42.2(pid=24858): stdout: | (launched: 2022-12-13_13:10:51.143312) 13:10:54.652500 run osmo-hlr_10.42.42.2(pid=24858): stderr: | 20221213131051325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131051325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131051325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131051325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131051325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131051325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131051337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131051348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131051348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131051348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:54.705803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24857): Terminating (SIGTERM) 13:10:54.748601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24861): Terminating (SIGTERM) 13:10:54.791583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24865): Terminating (SIGTERM) 13:10:54.834795 --- ParallelTerminationStrategy: PID 24857 died... 13:10:54.855471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24857): Terminated: ok {rc=0} 13:10:54.902640 --- ParallelTerminationStrategy: PID 24861 died... 13:10:54.922776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24861): Terminated: ok {rc=0} 13:10:54.969640 --- ParallelTerminationStrategy: PID 24865 died... 13:10:54.989767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24865): Terminated: ok {rc=0} 13:10:55.079617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:10:56.167482 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.179638 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:56.241621 tst ping_idle_ping.py: using LAC 34164 13:10:56.372438 tst ping_idle_ping.py: using RAC 249 13:10:56.503266 tst ping_idle_ping.py: using CellId 34164 13:10:56.634854 tst ping_idle_ping.py: using BVCI 34165 13:10:56.757233 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.768755 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.780100 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.791446 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.803034 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.815029 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.826969 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:56.838656 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:56.957071 tst ping_idle_ping.py:24: start network... 13:10:57.163779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:57.645559 run create_hlr_db(pid=24867): Launched 13:10:57.772814 bus /gobi_6: Setting Powered False 13:10:58.834450 run create_hlr_db(pid=24867): Terminated: ok {rc=0} 13:10:59.265469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24869): Launched 13:10:59.577589 run osmo-hlr_10.42.42.2(pid=24870): Launched 13:10:59.695584 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:00.231919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24872): Launched 13:11:00.541222 run osmo-stp_10.42.42.5(pid=24873): Launched 13:11:00.659660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:01.239099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24875): Launched 13:11:01.359247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:01.630248 run patchelf(pid=24876): Launched 13:11:01.816812 run osmo-stp_10.42.42.5(pid=24873): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24873)] 13:11:01.951969 run osmo-stp_10.42.42.5(pid=24873): stdout: | (launched: 2022-12-13_13:11:00.482666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:02.086823 run osmo-stp_10.42.42.5(pid=24873): stderr: | 20221213131100658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131100658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131100659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131100659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131100660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131100660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131100660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:02.221361 run osmo-stp_10.42.42.5(pid=24873): stdout: | (launched: 2022-12-13_13:11:00.482666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:02.347840 run osmo-stp_10.42.42.5(pid=24873): stderr: | 20221213131100658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131100658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131100659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131100659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131100660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131100660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131100660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:02.496847 run patchelf(pid=24876): Terminating (SIGINT) 13:11:02.670394 run patchelf(pid=24876): Terminated: ok {rc=0} 13:11:02.795063 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24873): Process ended prematurely: osmo-stp_10.42.42.5(pid=24873) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24873)] [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:11:02.804301 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:11:02.831203 run osmo-hlr_10.42.42.2(pid=24870): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24870)] 13:11:02.879330 run osmo-hlr_10.42.42.2(pid=24870): stdout: | (launched: 2022-12-13_13:10:59.518500) 13:11:02.929288 run osmo-hlr_10.42.42.2(pid=24870): stderr: | 20221213131059700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131059700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131059700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131059700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131059700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131059700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131059712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131059721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131059721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131059721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:02.980056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24869): Terminating (SIGTERM) 13:11:03.020555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24872): Terminating (SIGTERM) 13:11:03.060817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24875): Terminating (SIGTERM) 13:11:03.101632 --- ParallelTerminationStrategy: PID 24869 died... 13:11:03.121224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24869): Terminated: ok {rc=0} 13:11:03.165969 --- ParallelTerminationStrategy: PID 24872 died... 13:11:03.184761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24872): Terminated: ok {rc=0} 13:11:03.229617 --- ParallelTerminationStrategy: PID 24875 died... 13:11:03.248591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24875): Terminated: ok {rc=0} 13:11:03.335726 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:11:04.627606 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:04.634428 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:11:04.655315 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:11:04.689968 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:11:04.742664 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:11:04.763990 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:11:04.798756 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:11:05.359435 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:11:05.365250 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:05.376853 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:11:05.436410 tst switch_tch_pdch.py: using LAC 34165 13:11:05.568399 tst switch_tch_pdch.py: using RAC 250 13:11:05.696823 tst switch_tch_pdch.py: using CellId 34165 13:11:05.825285 tst switch_tch_pdch.py: using BVCI 34166 13:11:05.943998 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:05.955807 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:05.967367 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:05.978957 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:05.991038 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:06.002935 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:06.015620 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:06.027674 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:11:06.147152 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:11:06.264582 tst switch_tch_pdch.py:51: start network... 13:11:06.469228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:06.946420 run create_hlr_db(pid=24880): Launched 13:11:07.072649 bus /gobi_6: Setting Powered False 13:11:08.133800 run create_hlr_db(pid=24880): Terminated: ok {rc=0} 13:11:08.564045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Launched 13:11:08.874170 run osmo-hlr_10.42.42.2(pid=24883): Launched 13:11:08.990241 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:09.522067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Launched 13:11:09.829374 run osmo-stp_10.42.42.5(pid=24886): Launched 13:11:09.946322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:10.497332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Launched 13:11:10.613573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:10.873668 run patchelf(pid=24889): Launched 13:11:11.043826 run osmo-stp_10.42.42.5(pid=24886): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] 13:11:11.173304 run osmo-stp_10.42.42.5(pid=24886): stdout: | (launched: 2022-12-13_13:11:09.770990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:11.304308 run osmo-stp_10.42.42.5(pid=24886): stderr: | 20221213131109946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131109946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131109947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131109947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131109947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131109948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131109948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:11.436112 run osmo-stp_10.42.42.5(pid=24886): stdout: | (launched: 2022-12-13_13:11:09.770990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:11.561098 run osmo-stp_10.42.42.5(pid=24886): stderr: | 20221213131109946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131109946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131109947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131109947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131109947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131109948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131109948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:11.708713 run patchelf(pid=24889): Terminating (SIGINT) 13:11:11.880848 run patchelf(pid=24889): Terminated: ok {rc=0} 13:11:12.004786 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24886): Process ended prematurely: osmo-stp_10.42.42.5(pid=24886) [trial-2390↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] [trial-2390↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:11:12.013694 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:11:12.040432 run osmo-hlr_10.42.42.2(pid=24883): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24883)] 13:11:12.088238 run osmo-hlr_10.42.42.2(pid=24883): stdout: | (launched: 2022-12-13_13:11:08.815153) 13:11:12.137590 run osmo-hlr_10.42.42.2(pid=24883): stderr: | 20221213131108994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131108994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131108994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131108994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131108994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131108994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131109006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131109015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131109015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131109015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:12.188703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Terminating (SIGTERM) 13:11:12.228869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Terminating (SIGTERM) 13:11:12.269248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Terminating (SIGTERM) 13:11:12.309690 --- ParallelTerminationStrategy: PID 24882 died... 13:11:12.328904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Terminated: ok {rc=0} 13:11:12.373438 --- ParallelTerminationStrategy: PID 24885 died... 13:11:12.391894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Terminated: ok {rc=0} 13:11:12.435937 --- ParallelTerminationStrategy: PID 24888 died... 13:11:12.454525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Terminated: ok {rc=0} 13:11:12.539887 bus /gobi_0: Setting Powered False 13:11:13.639818 bus /gobi_0: Setting Powered False 13:11:14.756012 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:11:16.024671 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:16.031826 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:11:16.054355 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:11:16.094988 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:11:16.152081 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:11:16.174298 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:11:16.210392 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:11:16.786734 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:11:16.795111 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:16.811246 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:11:16.883320 tst switch_tch_pdch.py: using LAC 34166 13:11:17.040177 tst switch_tch_pdch.py: using RAC 251 13:11:17.164767 tst switch_tch_pdch.py: using CellId 34166 13:11:17.289378 tst switch_tch_pdch.py: using BVCI 34167 13:11:17.401145 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.412186 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.423195 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.433973 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.444744 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.455676 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.466747 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:17.477631 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:11:17.594180 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:11:17.716023 tst switch_tch_pdch.py:51: start network... 13:11:17.937244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:18.416800 run create_hlr_db(pid=24893): Launched 13:11:18.542278 bus /gobi_6: Setting Powered False 13:11:19.606654 run create_hlr_db(pid=24893): Terminated: ok {rc=0} 13:11:20.020216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Launched 13:11:20.352056 run osmo-hlr_10.42.42.2(pid=24896): Launched 13:11:20.477591 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:21.018628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Launched 13:11:21.347515 run osmo-stp_10.42.42.5(pid=24899): Launched 13:11:21.472475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:22.010679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Launched 13:11:22.135815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:22.413151 run patchelf(pid=24902): Launched 13:11:22.594908 run osmo-stp_10.42.42.5(pid=24899): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] 13:11:22.733284 run osmo-stp_10.42.42.5(pid=24899): stdout: | (launched: 2022-12-13_13:11:21.285615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:22.873115 run osmo-stp_10.42.42.5(pid=24899): stderr: | 20221213131121479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131121479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131121479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131121480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131121480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131121480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131121480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:23.014006 run osmo-stp_10.42.42.5(pid=24899): stdout: | (launched: 2022-12-13_13:11:21.285615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:23.147436 run osmo-stp_10.42.42.5(pid=24899): stderr: | 20221213131121479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131121479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131121479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131121480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131121480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131121480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131121480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:23.306420 run patchelf(pid=24902): Terminating (SIGINT) 13:11:23.489845 run patchelf(pid=24902): Terminated: ok {rc=0} 13:11:23.621734 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24899): Process ended prematurely: osmo-stp_10.42.42.5(pid=24899) [trial-2390↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] [trial-2390↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:11:23.631617 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:11:23.659914 run osmo-hlr_10.42.42.2(pid=24896): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24896)] 13:11:23.711190 run osmo-hlr_10.42.42.2(pid=24896): stdout: | (launched: 2022-12-13_13:11:20.290024) 13:11:23.763683 run osmo-hlr_10.42.42.2(pid=24896): stderr: | 20221213131120490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131120490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131120490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131120490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131120490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131120490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131120503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131120512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131120512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131120512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:23.816541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Terminating (SIGTERM) 13:11:23.859078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Terminating (SIGTERM) 13:11:23.901822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Terminating (SIGTERM) 13:11:23.944801 --- ParallelTerminationStrategy: PID 24895 died... 13:11:23.965725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24895): Terminated: ok {rc=0} 13:11:24.012875 --- ParallelTerminationStrategy: PID 24898 died... 13:11:24.033188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24898): Terminated: ok {rc=0} 13:11:24.080243 --- ParallelTerminationStrategy: PID 24901 died... 13:11:24.100428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24901): Terminated: ok {rc=0} 13:11:24.190906 bus /gobi_0: Setting Powered False 13:11:25.291093 bus /gobi_0: Setting Powered False 13:11:26.407438 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:oc2g --------------------------------------------------------------------- 13:11:27.650096 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:27.655355 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 13:11:27.676178 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 13:11:27.683034 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 13:11:27.735535 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 13:11:27.755910 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 13:11:27.762539 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 13:11:28.298760 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 13:11:28.303857 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 13:11:28.314546 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 13:11:28.348628 tst mo_mt_sms.py: using LAC 34167 13:11:28.479560 tst mo_mt_sms.py: using RAC 252 13:11:28.611192 tst mo_mt_sms.py: using CellId 34167 13:11:28.742262 tst mo_mt_sms.py: using BVCI 34168 13:11:28.862765 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 13:11:28.979414 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 13:11:29.101588 tst mo_mt_sms.py:9: start nitb and bts... 13:11:29.323399 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:11:29.993103 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24906): Launched 13:11:30.324719 run osmo-nitb_10.42.42.2(pid=24907): Launched 13:11:30.507067 run osmo-nitb_10.42.42.2(pid=24907): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24907)] 13:11:30.653819 run osmo-nitb_10.42.42.2(pid=24907): stdout: | (launched: 2022-12-13_13:11:30.263109) 13:11:30.802122 run osmo-nitb_10.42.42.2(pid=24907): stderr: | (launched: 2022-12-13_13:11:30.312165) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:30.960462 run osmo-nitb_10.42.42.2(pid=24907): stdout: | (launched: 2022-12-13_13:11:30.263109) 13:11:31.105807 run osmo-nitb_10.42.42.2(pid=24907): stderr: | (launched: 2022-12-13_13:11:30.312165) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24907) [trial-2390↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24907)] 13:11:31.449330 tst osmo-nitb_10.42.42.2(pid=24907): stdout: | (launched: 2022-12-13_13:11:30.263109) 13:11:31.582438 tst osmo-nitb_10.42.42.2(pid=24907): stderr: | (launched: 2022-12-13_13:11:30.312165) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:31.741737 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24907) [trial-2390↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24907)] [trial-2390↪nitb_sms:oc2g↪mo_mt_sms.py:11] 13:11:31.751355 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:11:31.759011 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24906): Terminating (SIGTERM) 13:11:31.972491 --- ParallelTerminationStrategy: PID 24906 died... 13:11:32.000410 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24906): Terminated: ok {rc=0} 13:11:32.114027 bus /sierra_3: Setting Powered False 13:11:33.214579 bus /sierra_3: Setting Powered False 13:11:34.331847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:oc2g --------------------------------------------------------------------- 13:11:35.513912 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:35.518333 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 13:11:35.539435 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 13:11:35.569227 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 13:11:35.624427 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 13:11:35.645128 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 13:11:35.671670 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 13:11:36.215459 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:oc2g mo_mt_sms.py ---------------------------------------------- 13:11:36.220752 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.231479 tst sms:oc2g: Using 1 x bts (candidates: 1) 13:11:36.265403 tst mo_mt_sms.py: using LAC 34168 13:11:36.394917 tst mo_mt_sms.py: using RAC 253 13:11:36.523274 tst mo_mt_sms.py: using CellId 34168 13:11:36.655535 tst mo_mt_sms.py: using BVCI 34169 13:11:36.776574 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.787665 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.798669 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.809578 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.821247 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:11:36.832813 tst sms:oc2g: Using 1 x modem (candidates: 2) 13:11:36.953399 tst sms:oc2g: Using 1 x modem (candidates: 2) 13:11:37.069558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:37.548093 run create_hlr_db(pid=24911): Launched 13:11:37.673732 bus /sierra_2: Setting Powered False 13:11:38.734836 run create_hlr_db(pid=24911): Terminated: ok {rc=0} 13:11:39.163375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24913): Launched 13:11:39.470325 run osmo-hlr_10.42.42.2(pid=24914): Launched 13:11:39.586215 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:40.131109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24916): Launched 13:11:40.438865 run osmo-stp_10.42.42.5(pid=24917): Launched 13:11:40.554828 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:41.110498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24919): Launched 13:11:41.418343 run osmo-msc_10.42.42.6(pid=24920): Launched 13:11:41.589299 run osmo-stp_10.42.42.5(pid=24917): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24917)] 13:11:41.719052 run osmo-stp_10.42.42.5(pid=24917): stdout: | (launched: 2022-12-13_13:11:40.380421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:41.848181 run osmo-stp_10.42.42.5(pid=24917): stderr: | 20221213131140554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131140554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131140554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131140555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131140555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131140555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131140555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:41.975345 run osmo-stp_10.42.42.5(pid=24917): stdout: | (launched: 2022-12-13_13:11:40.380421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:42.096223 run osmo-stp_10.42.42.5(pid=24917): stderr: | 20221213131140554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131140554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131140554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131140555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131140555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131140555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131140555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:42.241476 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24917): Process ended prematurely: osmo-stp_10.42.42.5(pid=24917) [trial-2390↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24917)] [trial-2390↪sms:oc2g↪mo_mt_sms.py:16] 13:11:42.250070 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:11:42.276159 run osmo-hlr_10.42.42.2(pid=24914): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24914)] 13:11:42.323759 run osmo-hlr_10.42.42.2(pid=24914): stdout: | (launched: 2022-12-13_13:11:39.412194) 13:11:42.372824 run osmo-hlr_10.42.42.2(pid=24914): stderr: | 20221213131139591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131139591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131139591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131139591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131139591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131139591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131139603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131139614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131139614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131139614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:42.441387 run osmo-msc_10.42.42.6(pid=24920): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24920)] 13:11:42.488737 run osmo-msc_10.42.42.6(pid=24920): stdout: | (launched: 2022-12-13_13:11:41.359816) 13:11:42.538006 run osmo-msc_10.42.42.6(pid=24920): stderr: | 20221213131141633 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131141633 DLGLOBAL DEBUG validating counter group 0x7f4b6376dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131141633 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131141633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131141633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131141633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131141635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131141635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131141636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131141636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:42.587359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24913): Terminating (SIGTERM) 13:11:42.626941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24916): Terminating (SIGTERM) 13:11:42.666529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24919): Terminating (SIGTERM) 13:11:42.706621 --- ParallelTerminationStrategy: PID 24913 died... 13:11:42.725791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24913): Terminated: ok {rc=0} 13:11:42.769491 --- ParallelTerminationStrategy: PID 24916 died... 13:11:42.787930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24916): Terminated: ok {rc=0} 13:11:42.832232 --- ParallelTerminationStrategy: PID 24919 died... 13:11:42.850955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24919): Terminated: ok {rc=0} 13:11:42.937819 bus /sierra_3: Setting Powered False 13:11:44.036607 bus /sierra_3: Setting Powered False 13:11:45.152914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:oc2g --------------------------------------------------------------------- 13:11:46.367908 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:46.373664 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 13:11:46.401198 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 13:11:46.410594 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 13:11:46.453250 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 13:11:46.488744 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 13:11:46.500462 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 13:11:47.024779 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 13:11:47.031922 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 13:11:47.045501 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 13:11:47.085409 tst assert_extension.py: using LAC 34169 13:11:47.237788 tst assert_extension.py: using RAC 254 13:11:47.368683 tst assert_extension.py: using CellId 34169 13:11:47.500422 tst assert_extension.py: using BVCI 34170 13:11:47.613359 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 13:11:47.731949 tst assert_extension.py:10: start nitb and bts... 13:11:47.953169 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:11:48.620844 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24925): Launched 13:11:48.950345 run osmo-nitb_10.42.42.2(pid=24926): Launched 13:11:49.131650 run osmo-nitb_10.42.42.2(pid=24926): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24926)] 13:11:49.278190 run osmo-nitb_10.42.42.2(pid=24926): stdout: | (launched: 2022-12-13_13:11:48.888478) 13:11:49.426490 run osmo-nitb_10.42.42.2(pid=24926): stderr: | (launched: 2022-12-13_13:11:48.937417) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:49.574416 run osmo-nitb_10.42.42.2(pid=24926): stdout: | (launched: 2022-12-13_13:11:48.888478) 13:11:49.716657 run osmo-nitb_10.42.42.2(pid=24926): stderr: | (launched: 2022-12-13_13:11:48.937417) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24926): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24926) [trial-2390↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24926)] 13:11:50.074220 tst osmo-nitb_10.42.42.2(pid=24926): stdout: | (launched: 2022-12-13_13:11:48.888478) 13:11:50.206260 tst osmo-nitb_10.42.42.2(pid=24926): stderr: | (launched: 2022-12-13_13:11:48.937417) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:50.361830 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24926): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24926) [trial-2390↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24926)] [trial-2390↪nitb_ussd:oc2g↪assert_extension.py:12] 13:11:50.371665 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:11:50.378971 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24925): Terminating (SIGTERM) 13:11:50.590854 --- ParallelTerminationStrategy: PID 24925 died... 13:11:50.612800 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24925): Terminated: ok {rc=0} 13:11:50.703343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:oc2g --------------------------------------------------------------------- 13:11:51.866370 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:51.870748 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 13:11:51.891874 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 13:11:51.919915 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 13:11:51.955550 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 13:11:51.976160 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 13:11:52.002628 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 13:11:52.530606 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:oc2g assert_extension.py ---------------------------------------------- 13:11:52.535574 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:52.546214 tst ussd:oc2g: Using 1 x bts (candidates: 1) 13:11:52.579207 tst assert_extension.py: using LAC 34170 13:11:52.708572 tst assert_extension.py: using RAC 255 13:11:52.838200 tst assert_extension.py: using CellId 34170 13:11:52.967798 tst assert_extension.py: using BVCI 34171 13:11:53.087210 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:53.098589 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:53.109804 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:53.120562 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:53.132109 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:11:53.143959 tst ussd:oc2g: Using 1 x modem (candidates: 1) 13:11:53.261053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:53.736085 run create_hlr_db(pid=24930): Launched 13:11:53.861224 bus /sierra_2: Setting Powered False 13:11:54.920167 run create_hlr_db(pid=24930): Terminated: ok {rc=0} 13:11:55.369307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Launched 13:11:55.699919 run osmo-hlr_10.42.42.2(pid=24933): Launched 13:11:55.825532 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:56.402030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Launched 13:11:56.732543 run osmo-stp_10.42.42.5(pid=24936): Launched 13:11:56.858179 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:57.450886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Launched 13:11:57.780822 run osmo-msc_10.42.42.6(pid=24939): Launched 13:11:57.963423 run osmo-stp_10.42.42.5(pid=24936): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24936)] 13:11:58.101892 run osmo-stp_10.42.42.5(pid=24936): stdout: | (launched: 2022-12-13_13:11:56.670680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:58.240887 run osmo-stp_10.42.42.5(pid=24936): stderr: | 20221213131156864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131156864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131156865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131156865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131156866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131156866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131156866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:58.378366 run osmo-stp_10.42.42.5(pid=24936): stdout: | (launched: 2022-12-13_13:11:56.670680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:58.509337 run osmo-stp_10.42.42.5(pid=24936): stderr: | 20221213131156864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131156864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131156865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131156865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131156866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131156866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131156866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:58.665581 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24936): Process ended prematurely: osmo-stp_10.42.42.5(pid=24936) [trial-2390↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24936)] [trial-2390↪ussd:oc2g↪assert_extension.py:17] 13:11:58.674654 tst assert_extension.py:17: Test FAILED (6.1 sec) 13:11:58.702496 run osmo-hlr_10.42.42.2(pid=24933): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24933)] 13:11:58.754276 run osmo-hlr_10.42.42.2(pid=24933): stdout: | (launched: 2022-12-13_13:11:55.638117) 13:11:58.806607 run osmo-hlr_10.42.42.2(pid=24933): stderr: | 20221213131155836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131155836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131155836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131155836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131155836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131155836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131155848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131155858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131155858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131155858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:58.878687 run osmo-msc_10.42.42.6(pid=24939): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24939)] 13:11:58.928924 run osmo-msc_10.42.42.6(pid=24939): stdout: | (launched: 2022-12-13_13:11:57.718840) 13:11:58.980827 run osmo-msc_10.42.42.6(pid=24939): stderr: | 20221213131158040 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131158040 DLGLOBAL DEBUG validating counter group 0x7fda694cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131158041 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131158041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131158041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131158041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131158043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131158043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131158043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131158043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:59.033558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Terminating (SIGTERM) 13:11:59.075444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Terminating (SIGTERM) 13:11:59.117948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Terminating (SIGTERM) 13:11:59.160677 --- ParallelTerminationStrategy: PID 24932 died... 13:11:59.181518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Terminated: ok {rc=0} 13:11:59.228393 --- ParallelTerminationStrategy: PID 24935 died... 13:11:59.248722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Terminated: ok {rc=0} 13:11:59.295501 --- ParallelTerminationStrategy: PID 24938 died... 13:11:59.315830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Terminated: ok {rc=0} 13:11:59.404697 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:12:00.601729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:00.608715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:12:00.630251 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:12:00.658992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:12:00.713572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:12:00.734541 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:12:00.762091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:12:01.318190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:12:01.389084 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:01.404083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:12:01.468789 tst mo_mt_call.py: using LAC 34171 13:12:01.645023 tst mo_mt_call.py: using RAC 1 13:12:01.778885 tst mo_mt_call.py: using CellId 34171 13:12:01.907659 tst mo_mt_call.py: using BVCI 34172 13:12:02.033420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:02.046286 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:02.059724 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:02.072225 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:02.085867 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:02.099280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:02.231588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:02.358388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:02.880720 run create_hlr_db(pid=24944): Launched 13:12:03.008764 bus /sierra_2: Setting Powered False 13:12:04.075284 run create_hlr_db(pid=24944): Terminated: ok {rc=0} 13:12:04.542816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24946): Launched 13:12:04.858649 run osmo-hlr_10.42.42.2(pid=24947): Launched 13:12:04.977673 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:05.534271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24949): Launched 13:12:05.849475 run osmo-stp_10.42.42.5(pid=24950): Launched 13:12:05.969336 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:06.539839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24952): Launched 13:12:06.855065 run osmo-msc_10.42.42.6(pid=24953): Launched 13:12:07.044395 run osmo-stp_10.42.42.5(pid=24950): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24950)] 13:12:07.188414 run osmo-stp_10.42.42.5(pid=24950): stdout: | (launched: 2022-12-13_13:12:05.789709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:07.331877 run osmo-stp_10.42.42.5(pid=24950): stderr: | 20221213131205963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131205963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131205963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131205964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131205964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131205964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131205964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:07.472118 run osmo-stp_10.42.42.5(pid=24950): stdout: | (launched: 2022-12-13_13:12:05.789709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:07.604888 run osmo-stp_10.42.42.5(pid=24950): stderr: | 20221213131205963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131205963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131205963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131205964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131205964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131205964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131205964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:07.763477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24950): Process ended prematurely: osmo-stp_10.42.42.5(pid=24950) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24950)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:12:07.773240 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:12:07.801215 run osmo-hlr_10.42.42.2(pid=24947): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24947)] 13:12:07.852641 run osmo-hlr_10.42.42.2(pid=24947): stdout: | (launched: 2022-12-13_13:12:04.799449) 13:12:07.904505 run osmo-hlr_10.42.42.2(pid=24947): stderr: | 20221213131204976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131204976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131204976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131204976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131204977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131204977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131204989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131204997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131204997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131204997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:07.977179 run osmo-msc_10.42.42.6(pid=24953): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24953)] 13:12:08.027119 run osmo-msc_10.42.42.6(pid=24953): stdout: | (launched: 2022-12-13_13:12:06.795241) 13:12:08.079439 run osmo-msc_10.42.42.6(pid=24953): stderr: | 20221213131207111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131207111 DLGLOBAL DEBUG validating counter group 0x7fe72d44ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131207112 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131207112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131207112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131207112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131207114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131207115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131207115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131207115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:08.131872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24946): Terminating (SIGTERM) 13:12:08.173709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24949): Terminating (SIGTERM) 13:12:08.215967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24952): Terminating (SIGTERM) 13:12:08.258726 --- ParallelTerminationStrategy: PID 24946 died... 13:12:08.279384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24946): Terminated: ok {rc=0} 13:12:08.326251 --- ParallelTerminationStrategy: PID 24949 died... 13:12:08.346595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24949): Terminated: ok {rc=0} 13:12:08.393662 --- ParallelTerminationStrategy: PID 24952 died... 13:12:08.413889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24952): Terminated: ok {rc=0} 13:12:08.503443 bus /sierra_3: Setting Powered False 13:12:09.602579 bus /sierra_3: Setting Powered False 13:12:10.721516 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:12:11.869401 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:11.881234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:12:11.938065 tst mo_mt_call_osmux.py: using LAC 34172 13:12:12.060736 tst mo_mt_call_osmux.py: using RAC 2 13:12:12.184744 tst mo_mt_call_osmux.py: using CellId 34172 13:12:12.308921 tst mo_mt_call_osmux.py: using BVCI 34173 13:12:12.425449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:12.436489 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:12.447529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:12.458464 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:12.469422 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:12.480353 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:12.602638 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:12.721617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:13.206698 run create_hlr_db(pid=24955): Launched 13:12:13.334235 bus /sierra_2: Setting Powered False 13:12:14.396170 run create_hlr_db(pid=24955): Terminated: ok {rc=0} 13:12:14.850672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Launched 13:12:15.165321 run osmo-hlr_10.42.42.2(pid=24958): Launched 13:12:15.285470 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:15.829696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Launched 13:12:16.200365 run osmo-stp_10.42.42.5(pid=24961): Launched 13:12:16.489106 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:17.180856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Launched 13:12:17.535213 run osmo-msc_10.42.42.6(pid=24964): Launched 13:12:17.723408 run osmo-stp_10.42.42.5(pid=24961): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24961)] 13:12:17.865155 run osmo-stp_10.42.42.5(pid=24961): stdout: | (launched: 2022-12-13_13:12:16.136555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:18.008429 run osmo-stp_10.42.42.5(pid=24961): stderr: | 20221213131216406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131216407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131216407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131216407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131216408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131216408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131216408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:18.147752 run osmo-stp_10.42.42.5(pid=24961): stdout: | (launched: 2022-12-13_13:12:16.136555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:18.280445 run osmo-stp_10.42.42.5(pid=24961): stderr: | 20221213131216406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131216407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131216407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131216407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131216408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131216408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131216408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:18.439308 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24961): Process ended prematurely: osmo-stp_10.42.42.5(pid=24961) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24961)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:12:18.448852 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:12:18.476805 run osmo-hlr_10.42.42.2(pid=24958): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24958)] 13:12:18.527804 run osmo-hlr_10.42.42.2(pid=24958): stdout: | (launched: 2022-12-13_13:12:15.105854) 13:12:18.579928 run osmo-hlr_10.42.42.2(pid=24958): stderr: | 20221213131215287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131215287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131215287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131215287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131215287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131215287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131215300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131215308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131215309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131215309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:18.651866 run osmo-msc_10.42.42.6(pid=24964): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24964)] 13:12:18.701548 run osmo-msc_10.42.42.6(pid=24964): stdout: | (launched: 2022-12-13_13:12:17.471719) 13:12:18.753301 run osmo-msc_10.42.42.6(pid=24964): stderr: | 20221213131217793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131217793 DLGLOBAL DEBUG validating counter group 0x7f77cd11dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131217793 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131217793 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131217794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131217794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131217795 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131217796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131217796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131217796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:18.805781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Terminating (SIGTERM) 13:12:18.847278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Terminating (SIGTERM) 13:12:18.889599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Terminating (SIGTERM) 13:12:18.931855 --- ParallelTerminationStrategy: PID 24957 died... 13:12:18.952354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Terminated: ok {rc=0} 13:12:18.998748 --- ParallelTerminationStrategy: PID 24960 died... 13:12:19.018831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Terminated: ok {rc=0} 13:12:19.065140 --- ParallelTerminationStrategy: PID 24963 died... 13:12:19.085067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Terminated: ok {rc=0} 13:12:19.172833 bus /sierra_3: Setting Powered False 13:12:20.271165 bus /sierra_3: Setting Powered False 13:12:21.388412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:12:22.627376 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:22.634592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:12:22.655864 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:12:22.685123 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:12:22.743449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:12:22.766184 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:12:22.794479 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:12:23.337785 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:12:23.388423 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.399590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:12:23.456464 tst mo_mt_call.py: using LAC 34173 13:12:23.576258 tst mo_mt_call.py: using RAC 3 13:12:23.695397 tst mo_mt_call.py: using CellId 34173 13:12:23.815584 tst mo_mt_call.py: using BVCI 34174 13:12:23.929153 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.940025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.950805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.961494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.972160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:23.982988 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:24.100768 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:24.219388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:24.694819 run create_hlr_db(pid=24969): Launched 13:12:24.820598 bus /sierra_2: Setting Powered False 13:12:25.881965 run create_hlr_db(pid=24969): Terminated: ok {rc=0} 13:12:26.330368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Launched 13:12:26.659903 run osmo-hlr_10.42.42.2(pid=24972): Launched 13:12:26.783938 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:27.351740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Launched 13:12:27.681894 run osmo-stp_10.42.42.5(pid=24975): Launched 13:12:27.805930 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:28.397433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24977): Launched 13:12:28.729062 run osmo-msc_10.42.42.6(pid=24978): Launched 13:12:28.911397 run osmo-stp_10.42.42.5(pid=24975): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] 13:12:29.051277 run osmo-stp_10.42.42.5(pid=24975): stdout: | (launched: 2022-12-13_13:12:27.620272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:29.190311 run osmo-stp_10.42.42.5(pid=24975): stderr: | 20221213131227811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131227811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131227812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131227812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131227812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131227813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131227813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:29.327562 run osmo-stp_10.42.42.5(pid=24975): stdout: | (launched: 2022-12-13_13:12:27.620272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:29.458776 run osmo-stp_10.42.42.5(pid=24975): stderr: | 20221213131227811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131227811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131227812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131227812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131227812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131227813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131227813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:29.614741 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24975): Process ended prematurely: osmo-stp_10.42.42.5(pid=24975) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:12:29.624123 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:12:29.651950 run osmo-hlr_10.42.42.2(pid=24972): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24972)] 13:12:29.702798 run osmo-hlr_10.42.42.2(pid=24972): stdout: | (launched: 2022-12-13_13:12:26.598553) 13:12:29.755008 run osmo-hlr_10.42.42.2(pid=24972): stderr: | 20221213131226794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131226795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131226795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131226795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131226795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131226795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131226807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131226816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131226816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131226816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:29.827238 run osmo-msc_10.42.42.6(pid=24978): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24978)] 13:12:29.877183 run osmo-msc_10.42.42.6(pid=24978): stdout: | (launched: 2022-12-13_13:12:28.667157) 13:12:29.929096 run osmo-msc_10.42.42.6(pid=24978): stderr: | 20221213131228989 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131228989 DLGLOBAL DEBUG validating counter group 0x7f9ad8bcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131228989 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131228990 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131228990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131228990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131228992 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131228992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131228992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131228992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:29.981309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Terminating (SIGTERM) 13:12:30.022780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Terminating (SIGTERM) 13:12:30.064700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24977): Terminating (SIGTERM) 13:12:30.106920 --- ParallelTerminationStrategy: PID 24971 died... 13:12:30.127287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24971): Terminated: ok {rc=0} 13:12:30.173565 --- ParallelTerminationStrategy: PID 24974 died... 13:12:30.193310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24974): Terminated: ok {rc=0} 13:12:30.238683 --- ParallelTerminationStrategy: PID 24977 died... 13:12:30.258306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24977): Terminated: ok {rc=0} 13:12:30.344613 bus /sierra_3: Setting Powered False 13:12:31.442779 bus /sierra_3: Setting Powered False 13:12:32.560147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:12:33.704756 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:33.716448 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:12:33.772731 tst mo_mt_call_osmux.py: using LAC 34174 13:12:33.894593 tst mo_mt_call_osmux.py: using RAC 4 13:12:34.016073 tst mo_mt_call_osmux.py: using CellId 34174 13:12:34.138299 tst mo_mt_call_osmux.py: using BVCI 34175 13:12:34.249944 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:34.260909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:34.271662 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:34.282477 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:34.293306 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:34.304054 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:34.420314 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:34.545664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:35.054154 run create_hlr_db(pid=24980): Launched 13:12:35.179723 bus /sierra_2: Setting Powered False 13:12:36.241051 run create_hlr_db(pid=24980): Terminated: ok {rc=0} 13:12:36.677019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24982): Launched 13:12:36.983329 run osmo-hlr_10.42.42.2(pid=24983): Launched 13:12:37.099151 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:37.642752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24985): Launched 13:12:37.949637 run osmo-stp_10.42.42.5(pid=24986): Launched 13:12:38.065877 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:38.620223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24988): Launched 13:12:38.926828 run osmo-msc_10.42.42.6(pid=24989): Launched 13:12:39.097201 run osmo-stp_10.42.42.5(pid=24986): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24986)] 13:12:39.225246 run osmo-stp_10.42.42.5(pid=24986): stdout: | (launched: 2022-12-13_13:12:37.891933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:39.353500 run osmo-stp_10.42.42.5(pid=24986): stderr: | 20221213131238062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131238062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131238062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131238062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131238063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131238063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131238063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:39.481503 run osmo-stp_10.42.42.5(pid=24986): stdout: | (launched: 2022-12-13_13:12:37.891933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:39.602262 run osmo-stp_10.42.42.5(pid=24986): stderr: | 20221213131238062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131238062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131238062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131238062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131238063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131238063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131238063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:39.746456 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24986): Process ended prematurely: osmo-stp_10.42.42.5(pid=24986) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24986)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:12:39.755480 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:12:39.781883 run osmo-hlr_10.42.42.2(pid=24983): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24983)] 13:12:39.829584 run osmo-hlr_10.42.42.2(pid=24983): stdout: | (launched: 2022-12-13_13:12:36.925874) 13:12:39.878577 run osmo-hlr_10.42.42.2(pid=24983): stderr: | 20221213131237101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131237101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131237101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131237101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131237101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131237101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131237113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131237123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131237123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131237123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:39.947348 run osmo-msc_10.42.42.6(pid=24989): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24989)] 13:12:39.994282 run osmo-msc_10.42.42.6(pid=24989): stdout: | (launched: 2022-12-13_13:12:38.869152) 13:12:40.043091 run osmo-msc_10.42.42.6(pid=24989): stderr: | 20221213131239140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131239141 DLGLOBAL DEBUG validating counter group 0x7f60b4f5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131239141 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131239141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131239141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131239141 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131239143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131239143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131239144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131239144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:40.092362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24982): Terminating (SIGTERM) 13:12:40.131686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24985): Terminating (SIGTERM) 13:12:40.170828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24988): Terminating (SIGTERM) 13:12:40.210435 --- ParallelTerminationStrategy: PID 24982 died... 13:12:40.229718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24982): Terminated: ok {rc=0} 13:12:40.273353 --- ParallelTerminationStrategy: PID 24985 died... 13:12:40.292018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24985): Terminated: ok {rc=0} 13:12:40.335635 --- ParallelTerminationStrategy: PID 24988 died... 13:12:40.354326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24988): Terminated: ok {rc=0} 13:12:40.438466 bus /sierra_3: Setting Powered False 13:12:41.536801 bus /sierra_3: Setting Powered False 13:12:42.651733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:12:43.882860 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:43.891010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:12:43.912306 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:12:43.940074 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:12:43.994741 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:12:44.017212 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:12:44.045038 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:12:44.593509 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:12:44.647076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:44.658691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:12:44.717632 tst mo_mt_call.py: using LAC 34175 13:12:44.839655 tst mo_mt_call.py: using RAC 5 13:12:44.962277 tst mo_mt_call.py: using CellId 34175 13:12:45.084025 tst mo_mt_call.py: using BVCI 34176 13:12:45.197117 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:45.208379 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:45.219147 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:45.229931 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:45.240624 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:45.251415 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:45.372611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:45.491600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:46.016734 run create_hlr_db(pid=24994): Launched 13:12:46.181660 bus /sierra_2: Setting Powered False 13:12:47.244886 run create_hlr_db(pid=24994): Terminated: ok {rc=0} 13:12:47.705081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24996): Launched 13:12:48.035138 run osmo-hlr_10.42.42.2(pid=24997): Launched 13:12:48.162285 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:48.727526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24999): Launched 13:12:49.057306 run osmo-stp_10.42.42.5(pid=25000): Launched 13:12:49.182182 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:49.775258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25002): Launched 13:12:50.104138 run osmo-msc_10.42.42.6(pid=25003): Launched 13:12:50.286003 run osmo-stp_10.42.42.5(pid=25000): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25000)] 13:12:50.423864 run osmo-stp_10.42.42.5(pid=25000): stdout: | (launched: 2022-12-13_13:12:48.995533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:50.562675 run osmo-stp_10.42.42.5(pid=25000): stderr: | 20221213131249187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131249187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131249187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131249187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131249188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131249188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131249188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:50.699500 run osmo-stp_10.42.42.5(pid=25000): stdout: | (launched: 2022-12-13_13:12:48.995533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:50.829370 run osmo-stp_10.42.42.5(pid=25000): stderr: | 20221213131249187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131249187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131249187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131249187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131249188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131249188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131249188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:50.984641 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25000): Process ended prematurely: osmo-stp_10.42.42.5(pid=25000) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25000)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:12:50.994381 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:12:51.021972 run osmo-hlr_10.42.42.2(pid=24997): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24997)] 13:12:51.072177 run osmo-hlr_10.42.42.2(pid=24997): stdout: | (launched: 2022-12-13_13:12:47.973747) 13:12:51.123904 run osmo-hlr_10.42.42.2(pid=24997): stderr: | 20221213131248172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131248172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131248172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131248172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131248172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131248172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131248184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131248194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131248194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131248194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:51.195499 run osmo-msc_10.42.42.6(pid=25003): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25003)] 13:12:51.244718 run osmo-msc_10.42.42.6(pid=25003): stdout: | (launched: 2022-12-13_13:12:50.042617) 13:12:51.295943 run osmo-msc_10.42.42.6(pid=25003): stderr: | 20221213131250363 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131250363 DLGLOBAL DEBUG validating counter group 0x7f62f4823c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131250364 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131250364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131250364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131250364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131250366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131250366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131250366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131250366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:51.347800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24996): Terminating (SIGTERM) 13:12:51.389349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24999): Terminating (SIGTERM) 13:12:51.431732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25002): Terminating (SIGTERM) 13:12:51.474124 --- ParallelTerminationStrategy: PID 24996 died... 13:12:51.494749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24996): Terminated: ok {rc=0} 13:12:51.540758 --- ParallelTerminationStrategy: PID 24999 died... 13:12:51.560578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24999): Terminated: ok {rc=0} 13:12:51.606648 --- ParallelTerminationStrategy: PID 25002 died... 13:12:51.626483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25002): Terminated: ok {rc=0} 13:12:51.714249 bus /sierra_3: Setting Powered False 13:12:52.811997 bus /sierra_3: Setting Powered False 13:12:53.932314 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:12:55.080663 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.092905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:12:55.153711 tst mo_mt_call_osmux.py: using LAC 34176 13:12:55.280132 tst mo_mt_call_osmux.py: using RAC 6 13:12:55.405339 tst mo_mt_call_osmux.py: using CellId 34176 13:12:55.529704 tst mo_mt_call_osmux.py: using BVCI 34177 13:12:55.649007 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.660530 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.671872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.683109 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.694714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:55.706352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:55.825594 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:55.942226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:56.412031 run create_hlr_db(pid=25005): Launched 13:12:56.536449 bus /sierra_2: Setting Powered False 13:12:57.596862 run create_hlr_db(pid=25005): Terminated: ok {rc=0} 13:12:58.018450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Launched 13:12:58.320654 run osmo-hlr_10.42.42.2(pid=25008): Launched 13:12:58.434668 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:58.956887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Launched 13:12:59.259354 run osmo-stp_10.42.42.5(pid=25011): Launched 13:12:59.374662 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:59.922611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Launched 13:13:00.225204 run osmo-msc_10.42.42.6(pid=25014): Launched 13:13:00.394770 run osmo-stp_10.42.42.5(pid=25011): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] 13:13:00.522764 run osmo-stp_10.42.42.5(pid=25011): stdout: | (launched: 2022-12-13_13:12:59.203144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:00.650703 run osmo-stp_10.42.42.5(pid=25011): stderr: | 20221213131259371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131259371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131259371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131259372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131259372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131259372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131259372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:00.776907 run osmo-stp_10.42.42.5(pid=25011): stdout: | (launched: 2022-12-13_13:12:59.203144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:00.915183 run osmo-stp_10.42.42.5(pid=25011): stderr: | 20221213131259371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131259371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131259371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131259372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131259372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131259372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131259372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:01.061398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25011): Process ended prematurely: osmo-stp_10.42.42.5(pid=25011) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:13:01.070786 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:13:01.097820 run osmo-hlr_10.42.42.2(pid=25008): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25008)] 13:13:01.145745 run osmo-hlr_10.42.42.2(pid=25008): stdout: | (launched: 2022-12-13_13:12:58.264422) 13:13:01.195575 run osmo-hlr_10.42.42.2(pid=25008): stderr: | 20221213131258437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131258437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131258437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131258437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131258438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131258438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131258450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131258460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131258460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131258460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:01.264916 run osmo-msc_10.42.42.6(pid=25014): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25014)] 13:13:01.313226 run osmo-msc_10.42.42.6(pid=25014): stdout: | (launched: 2022-12-13_13:13:00.168619) 13:13:01.363168 run osmo-msc_10.42.42.6(pid=25014): stderr: | 20221213131300439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131300440 DLGLOBAL DEBUG validating counter group 0x7f663f53cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131300440 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131300440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131300440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131300440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131300442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131300442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131300443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131300443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:01.413566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Terminating (SIGTERM) 13:13:01.453678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Terminating (SIGTERM) 13:13:01.494212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Terminating (SIGTERM) 13:13:01.534895 --- ParallelTerminationStrategy: PID 25007 died... 13:13:01.554618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Terminated: ok {rc=0} 13:13:01.599401 --- ParallelTerminationStrategy: PID 25010 died... 13:13:01.618562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Terminated: ok {rc=0} 13:13:01.663041 --- ParallelTerminationStrategy: PID 25013 died... 13:13:01.682244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Terminated: ok {rc=0} 13:13:01.772305 bus /sierra_3: Setting Powered False 13:13:02.873641 bus /sierra_3: Setting Powered False 13:13:03.986007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:13:05.217861 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:05.224146 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:13:05.244323 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:13:05.274303 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:13:05.328334 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:13:05.350109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:13:05.377568 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:13:05.924632 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:13:05.973968 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:05.985073 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:13:06.042300 tst mo_mt_call.py: using LAC 34177 13:13:06.162477 tst mo_mt_call.py: using RAC 7 13:13:06.282656 tst mo_mt_call.py: using CellId 34177 13:13:06.402762 tst mo_mt_call.py: using BVCI 34178 13:13:06.513448 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:06.524328 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:06.535033 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:06.545737 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:06.556397 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:06.567176 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:06.681741 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:06.804548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:07.306724 run create_hlr_db(pid=25020): Launched 13:13:07.432866 bus /sierra_2: Setting Powered False 13:13:08.496884 run create_hlr_db(pid=25020): Terminated: ok {rc=0} 13:13:08.929309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Launched 13:13:09.231463 run osmo-hlr_10.42.42.2(pid=25023): Launched 13:13:09.346217 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:09.879399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25025): Launched 13:13:10.180911 run osmo-stp_10.42.42.5(pid=25026): Launched 13:13:10.294982 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:10.839621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25028): Launched 13:13:11.141279 run osmo-msc_10.42.42.6(pid=25029): Launched 13:13:11.309650 run osmo-stp_10.42.42.5(pid=25026): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25026)] 13:13:11.437799 run osmo-stp_10.42.42.5(pid=25026): stdout: | (launched: 2022-12-13_13:13:10.125772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:11.565169 run osmo-stp_10.42.42.5(pid=25026): stderr: | 20221213131310294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131310294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131310294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131310295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131310295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131310295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131310295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:11.691251 run osmo-stp_10.42.42.5(pid=25026): stdout: | (launched: 2022-12-13_13:13:10.125772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:11.811157 run osmo-stp_10.42.42.5(pid=25026): stderr: | 20221213131310294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131310294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131310294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131310295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131310295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131310295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131310295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:11.954380 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25026): Process ended prematurely: osmo-stp_10.42.42.5(pid=25026) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25026)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:13:11.963196 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:13:11.989284 run osmo-hlr_10.42.42.2(pid=25023): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25023)] 13:13:12.036469 run osmo-hlr_10.42.42.2(pid=25023): stdout: | (launched: 2022-12-13_13:13:09.176230) 13:13:12.085090 run osmo-hlr_10.42.42.2(pid=25023): stderr: | 20221213131309349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131309349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131309349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131309349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131309349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131309349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131309362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131309372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131309372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131309372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:12.153129 run osmo-msc_10.42.42.6(pid=25029): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25029)] 13:13:12.200163 run osmo-msc_10.42.42.6(pid=25029): stdout: | (launched: 2022-12-13_13:13:11.085630) 13:13:12.248690 run osmo-msc_10.42.42.6(pid=25029): stderr: | 20221213131311355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131311355 DLGLOBAL DEBUG validating counter group 0x7fd824e09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131311355 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131311355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131311356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131311356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131311358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131311358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131311358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131311358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:12.297783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Terminating (SIGTERM) 13:13:12.336942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25025): Terminating (SIGTERM) 13:13:12.376024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25028): Terminating (SIGTERM) 13:13:12.415420 --- ParallelTerminationStrategy: PID 25022 died... 13:13:12.434271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Terminated: ok {rc=0} 13:13:12.477465 --- ParallelTerminationStrategy: PID 25025 died... 13:13:12.495653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25025): Terminated: ok {rc=0} 13:13:12.539000 --- ParallelTerminationStrategy: PID 25028 died... 13:13:12.557429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25028): Terminated: ok {rc=0} 13:13:12.639957 bus /sierra_3: Setting Powered False 13:13:13.733725 bus /sierra_3: Setting Powered False 13:13:14.847348 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:13:16.000139 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.013728 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:13:16.074418 tst mo_mt_call_osmux.py: using LAC 34178 13:13:16.232442 tst mo_mt_call_osmux.py: using RAC 8 13:13:16.365388 tst mo_mt_call_osmux.py: using CellId 34178 13:13:16.522400 tst mo_mt_call_osmux.py: using BVCI 34179 13:13:16.670136 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.684466 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.698841 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.713622 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.728840 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:16.743650 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:16.886734 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:17.014614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:17.530778 run create_hlr_db(pid=25031): Launched 13:13:17.655638 bus /sierra_2: Setting Powered False 13:13:18.720379 run create_hlr_db(pid=25031): Terminated: ok {rc=0} 13:13:19.170740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25033): Launched 13:13:19.497339 run osmo-hlr_10.42.42.2(pid=25034): Launched 13:13:19.620732 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:20.183271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25036): Launched 13:13:20.510283 run osmo-stp_10.42.42.5(pid=25037): Launched 13:13:20.632840 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:21.217226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25039): Launched 13:13:21.542020 run osmo-msc_10.42.42.6(pid=25040): Launched 13:13:21.723078 run osmo-stp_10.42.42.5(pid=25037): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25037)] 13:13:21.859899 run osmo-stp_10.42.42.5(pid=25037): stdout: | (launched: 2022-12-13_13:13:20.450685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:21.997738 run osmo-stp_10.42.42.5(pid=25037): stderr: | 20221213131320638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131320638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131320639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131320639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131320639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131320640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131320640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:22.133518 run osmo-stp_10.42.42.5(pid=25037): stdout: | (launched: 2022-12-13_13:13:20.450685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:22.262460 run osmo-stp_10.42.42.5(pid=25037): stderr: | 20221213131320638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131320638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131320639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131320639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131320639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131320640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131320640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:22.417222 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25037): Process ended prematurely: osmo-stp_10.42.42.5(pid=25037) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25037)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:13:22.427025 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:13:22.454824 run osmo-hlr_10.42.42.2(pid=25034): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25034)] 13:13:22.505355 run osmo-hlr_10.42.42.2(pid=25034): stdout: | (launched: 2022-12-13_13:13:19.437515) 13:13:22.556937 run osmo-hlr_10.42.42.2(pid=25034): stderr: | 20221213131319633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131319633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131319633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131319633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131319633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131319633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131319645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131319654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131319654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131319654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:22.628524 run osmo-msc_10.42.42.6(pid=25040): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25040)] 13:13:22.677693 run osmo-msc_10.42.42.6(pid=25040): stdout: | (launched: 2022-12-13_13:13:21.482969) 13:13:22.729053 run osmo-msc_10.42.42.6(pid=25040): stderr: | 20221213131321802 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131321802 DLGLOBAL DEBUG validating counter group 0x7f997ea54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131321802 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131321802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131321803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131321803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131321805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131321805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131321805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131321805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:22.780722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25033): Terminating (SIGTERM) 13:13:22.822071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25036): Terminating (SIGTERM) 13:13:22.864014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25039): Terminating (SIGTERM) 13:13:22.906032 --- ParallelTerminationStrategy: PID 25033 died... 13:13:22.926262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25033): Terminated: ok {rc=0} 13:13:22.972076 --- ParallelTerminationStrategy: PID 25036 died... 13:13:22.991715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25036): Terminated: ok {rc=0} 13:13:23.037440 --- ParallelTerminationStrategy: PID 25039 died... 13:13:23.057203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25039): Terminated: ok {rc=0} 13:13:23.143397 bus /sierra_3: Setting Powered False 13:13:24.247691 bus /sierra_3: Setting Powered False 13:13:25.361658 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:13:26.596510 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:26.603634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:13:26.624791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:13:26.653392 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:13:26.707777 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:13:26.728593 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:13:26.755874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:13:27.306505 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:13:27.360229 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.371788 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:13:27.429840 tst mo_mt_call.py: using LAC 34179 13:13:27.558630 tst mo_mt_call.py: using RAC 9 13:13:27.685837 tst mo_mt_call.py: using CellId 34179 13:13:27.812785 tst mo_mt_call.py: using BVCI 34180 13:13:27.933122 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.944565 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.955791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.967130 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.978818 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:27.990514 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:28.106895 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:28.227814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:28.730947 run create_hlr_db(pid=25045): Launched 13:13:28.856409 bus /sierra_2: Setting Powered False 13:13:29.920868 run create_hlr_db(pid=25045): Terminated: ok {rc=0} 13:13:30.352780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25047): Launched 13:13:30.655320 run osmo-hlr_10.42.42.2(pid=25048): Launched 13:13:30.771402 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:31.426695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25050): Launched 13:13:31.749675 run osmo-stp_10.42.42.5(pid=25051): Launched 13:13:31.993175 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:32.655490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25053): Launched 13:13:32.959033 run osmo-msc_10.42.42.6(pid=25054): Launched 13:13:33.127904 run osmo-stp_10.42.42.5(pid=25051): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25051)] 13:13:33.255360 run osmo-stp_10.42.42.5(pid=25051): stdout: | (launched: 2022-12-13_13:13:31.691590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:33.382978 run osmo-stp_10.42.42.5(pid=25051): stderr: | 20221213131332007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131332007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131332007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131332008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131332008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131332008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131332008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:33.509126 run osmo-stp_10.42.42.5(pid=25051): stdout: | (launched: 2022-12-13_13:13:31.691590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:33.628397 run osmo-stp_10.42.42.5(pid=25051): stderr: | 20221213131332007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131332007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131332007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131332008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131332008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131332008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131332008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:33.771863 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25051): Process ended prematurely: osmo-stp_10.42.42.5(pid=25051) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25051)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:13:33.780795 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:13:33.807484 run osmo-hlr_10.42.42.2(pid=25048): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25048)] 13:13:33.855044 run osmo-hlr_10.42.42.2(pid=25048): stdout: | (launched: 2022-12-13_13:13:30.599722) 13:13:33.903732 run osmo-hlr_10.42.42.2(pid=25048): stderr: | 20221213131330772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131330772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131330772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131330773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131330773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131330773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131330785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131330793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131330793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131330793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:33.971894 run osmo-msc_10.42.42.6(pid=25054): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25054)] 13:13:34.019027 run osmo-msc_10.42.42.6(pid=25054): stdout: | (launched: 2022-12-13_13:13:32.903238) 13:13:34.067632 run osmo-msc_10.42.42.6(pid=25054): stderr: | 20221213131333175 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131333175 DLGLOBAL DEBUG validating counter group 0x7f49843f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131333175 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131333175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131333175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131333175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131333177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131333178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131333178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131333178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:34.116590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25047): Terminating (SIGTERM) 13:13:34.155934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25050): Terminating (SIGTERM) 13:13:34.195187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25053): Terminating (SIGTERM) 13:13:34.234697 --- ParallelTerminationStrategy: PID 25047 died... 13:13:34.254138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25047): Terminated: ok {rc=0} 13:13:34.297921 --- ParallelTerminationStrategy: PID 25050 died... 13:13:34.316538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25050): Terminated: ok {rc=0} 13:13:34.359915 --- ParallelTerminationStrategy: PID 25053 died... 13:13:34.378373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25053): Terminated: ok {rc=0} 13:13:34.461332 bus /sierra_3: Setting Powered False 13:13:35.558793 bus /sierra_3: Setting Powered False 13:13:36.678558 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:13:37.824716 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:37.836602 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:13:37.892813 tst mo_mt_call_osmux.py: using LAC 34180 13:13:38.013462 tst mo_mt_call_osmux.py: using RAC 10 13:13:38.132133 tst mo_mt_call_osmux.py: using CellId 34180 13:13:38.252795 tst mo_mt_call_osmux.py: using BVCI 34181 13:13:38.362699 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:38.373934 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:38.384738 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:38.395506 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:38.406379 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:38.417348 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:38.537232 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:38.654434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:39.124207 run create_hlr_db(pid=25056): Launched 13:13:39.248077 bus /sierra_2: Setting Powered False 13:13:40.309306 run create_hlr_db(pid=25056): Terminated: ok {rc=0} 13:13:40.751177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25058): Launched 13:13:41.058723 run osmo-hlr_10.42.42.2(pid=25059): Launched 13:13:41.172099 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:41.708281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25061): Launched 13:13:42.011093 run osmo-stp_10.42.42.5(pid=25062): Launched 13:13:42.125227 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:42.670177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25064): Launched 13:13:42.974436 run osmo-msc_10.42.42.6(pid=25065): Launched 13:13:43.144192 run osmo-stp_10.42.42.5(pid=25062): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25062)] 13:13:43.271364 run osmo-stp_10.42.42.5(pid=25062): stdout: | (launched: 2022-12-13_13:13:41.955238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:43.399185 run osmo-stp_10.42.42.5(pid=25062): stderr: | 20221213131342122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131342122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131342122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131342123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131342123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131342123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131342123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:43.525348 run osmo-stp_10.42.42.5(pid=25062): stdout: | (launched: 2022-12-13_13:13:41.955238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:43.644863 run osmo-stp_10.42.42.5(pid=25062): stderr: | 20221213131342122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131342122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131342122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131342123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131342123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131342123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131342123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:43.787935 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25062): Process ended prematurely: osmo-stp_10.42.42.5(pid=25062) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25062)] [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:13:43.797083 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:13:43.823549 run osmo-hlr_10.42.42.2(pid=25059): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25059)] 13:13:43.870716 run osmo-hlr_10.42.42.2(pid=25059): stdout: | (launched: 2022-12-13_13:13:41.002885) 13:13:43.920016 run osmo-hlr_10.42.42.2(pid=25059): stderr: | 20221213131341177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131341177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131341177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131341177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131341177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131341177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131341189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131341199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131341199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131341199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:43.988205 run osmo-msc_10.42.42.6(pid=25065): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25065)] 13:13:44.035426 run osmo-msc_10.42.42.6(pid=25065): stdout: | (launched: 2022-12-13_13:13:42.918488) 13:13:44.084580 run osmo-msc_10.42.42.6(pid=25065): stderr: | 20221213131343188 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131343188 DLGLOBAL DEBUG validating counter group 0x7febe88cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131343188 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131343188 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131343188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131343189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131343190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131343191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131343191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131343191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:44.133951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25058): Terminating (SIGTERM) 13:13:44.173530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25061): Terminating (SIGTERM) 13:13:44.212875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25064): Terminating (SIGTERM) 13:13:44.252811 --- ParallelTerminationStrategy: PID 25058 died... 13:13:44.272122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25058): Terminated: ok {rc=0} 13:13:44.315738 --- ParallelTerminationStrategy: PID 25061 died... 13:13:44.334414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25061): Terminated: ok {rc=0} 13:13:44.378151 --- ParallelTerminationStrategy: PID 25064 died... 13:13:44.396885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25064): Terminated: ok {rc=0} 13:13:44.482403 bus /sierra_3: Setting Powered False 13:13:45.579666 bus /sierra_3: Setting Powered False 13:13:46.694599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:13:47.934447 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:47.940899 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:13:47.961193 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:13:47.987857 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:13:48.038293 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:13:48.058821 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:13:48.085058 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:13:48.637303 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:13:48.686443 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:48.697594 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:13:48.754397 tst mo_mt_call.py: using LAC 34181 13:13:48.873611 tst mo_mt_call.py: using RAC 11 13:13:49.003060 tst mo_mt_call.py: using CellId 34181 13:13:49.133762 tst mo_mt_call.py: using BVCI 34182 13:13:49.245225 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:49.256277 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:49.267359 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:49.278268 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:49.289772 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:49.301289 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:49.422049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:49.538643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:50.008445 run create_hlr_db(pid=25070): Launched 13:13:50.132476 bus /sierra_2: Setting Powered False 13:13:51.192921 run create_hlr_db(pid=25070): Terminated: ok {rc=0} 13:13:51.614504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Launched 13:13:51.916758 run osmo-hlr_10.42.42.2(pid=25074): Launched 13:13:52.030719 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:52.565414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Launched 13:13:52.869293 run osmo-stp_10.42.42.5(pid=25077): Launched 13:13:52.983433 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:53.528618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Launched 13:13:53.830833 run osmo-msc_10.42.42.6(pid=25080): Launched 13:13:53.999824 run osmo-stp_10.42.42.5(pid=25077): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] 13:13:54.127302 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-13_13:13:52.812613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:54.254877 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221213131352980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131352980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131352980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131352981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131352981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131352981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131352981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:54.380541 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-13_13:13:52.812613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:54.499778 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221213131352980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131352980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131352980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131352981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131352981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131352981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131352981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:54.642814 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:13:54.651707 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:13:54.677893 run osmo-hlr_10.42.42.2(pid=25074): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25074)] 13:13:54.724872 run osmo-hlr_10.42.42.2(pid=25074): stdout: | (launched: 2022-12-13_13:13:51.861445) 13:13:54.773911 run osmo-hlr_10.42.42.2(pid=25074): stderr: | 20221213131352034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131352034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131352034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131352034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131352034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131352034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131352046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131352056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131352056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131352056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:54.842417 run osmo-msc_10.42.42.6(pid=25080): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25080)] 13:13:54.889717 run osmo-msc_10.42.42.6(pid=25080): stdout: | (launched: 2022-12-13_13:13:53.775054) 13:13:54.938353 run osmo-msc_10.42.42.6(pid=25080): stderr: | 20221213131354045 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131354045 DLGLOBAL DEBUG validating counter group 0x7f03f8ed2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131354045 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131354045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131354046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131354046 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131354047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131354048 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131354048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131354048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:54.987605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminating (SIGTERM) 13:13:55.026970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminating (SIGTERM) 13:13:55.066303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminating (SIGTERM) 13:13:55.105873 --- ParallelTerminationStrategy: PID 25073 died... 13:13:55.125016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminated: ok {rc=0} 13:13:55.168569 --- ParallelTerminationStrategy: PID 25076 died... 13:13:55.187199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminated: ok {rc=0} 13:13:55.230814 --- ParallelTerminationStrategy: PID 25079 died... 13:13:55.249389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminated: ok {rc=0} 13:13:55.335767 bus /sierra_3: Setting Powered False 13:13:56.434663 bus /sierra_3: Setting Powered False 13:13:57.548479 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:13:58.701279 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:58.713638 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:13:58.777215 tst mo_mt_call_osmux.py: using LAC 34182 13:13:58.909677 tst mo_mt_call_osmux.py: using RAC 12 13:13:59.037805 tst mo_mt_call_osmux.py: using CellId 34182 13:13:59.166470 tst mo_mt_call_osmux.py: using BVCI 34183 13:13:59.287127 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:59.298963 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:59.310472 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:59.321900 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:59.333809 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:59.345932 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:59.462227 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:59.583256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:00.088000 run create_hlr_db(pid=25082): Launched 13:14:00.212433 bus /sierra_2: Setting Powered False 13:14:01.291183 run create_hlr_db(pid=25082): Terminated: ok {rc=0} 13:14:01.832660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25084): Launched 13:14:02.176634 run osmo-hlr_10.42.42.2(pid=25085): Launched 13:14:02.316223 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:02.880856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25087): Launched 13:14:03.205679 run osmo-stp_10.42.42.5(pid=25088): Launched 13:14:03.331420 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:03.922392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25090): Launched 13:14:04.249501 run osmo-msc_10.42.42.6(pid=25091): Launched 13:14:04.431630 run osmo-stp_10.42.42.5(pid=25088): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25088)] 13:14:04.569918 run osmo-stp_10.42.42.5(pid=25088): stdout: | (launched: 2022-12-13_13:14:03.146609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:04.708244 run osmo-stp_10.42.42.5(pid=25088): stderr: | 20221213131403335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131403335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131403335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131403336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131403336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131403336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131403336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:04.845372 run osmo-stp_10.42.42.5(pid=25088): stdout: | (launched: 2022-12-13_13:14:03.146609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:04.975671 run osmo-stp_10.42.42.5(pid=25088): stderr: | 20221213131403335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131403335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131403335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131403336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131403336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131403336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131403336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:05.131112 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25088): Process ended prematurely: osmo-stp_10.42.42.5(pid=25088) [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25088)] [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:14:05.140764 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:14:05.168577 run osmo-hlr_10.42.42.2(pid=25085): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25085)] 13:14:05.219554 run osmo-hlr_10.42.42.2(pid=25085): stdout: | (launched: 2022-12-13_13:14:02.117811) 13:14:05.271192 run osmo-hlr_10.42.42.2(pid=25085): stderr: | 20221213131402386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131402386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131402386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131402386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131402386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131402386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131402398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131402406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131402407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131402407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:05.343134 run osmo-msc_10.42.42.6(pid=25091): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25091)] 13:14:05.392384 run osmo-msc_10.42.42.6(pid=25091): stdout: | (launched: 2022-12-13_13:14:04.189749) 13:14:05.444447 run osmo-msc_10.42.42.6(pid=25091): stderr: | 20221213131404510 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131404510 DLGLOBAL DEBUG validating counter group 0x7f434e2e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131404510 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131404510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131404510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131404511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131404512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131404513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131404513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131404513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:05.496488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25084): Terminating (SIGTERM) 13:14:05.538219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25087): Terminating (SIGTERM) 13:14:05.580126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25090): Terminating (SIGTERM) 13:14:05.622442 --- ParallelTerminationStrategy: PID 25084 died... 13:14:05.643018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25084): Terminated: ok {rc=0} 13:14:05.689533 --- ParallelTerminationStrategy: PID 25087 died... 13:14:05.709689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25087): Terminated: ok {rc=0} 13:14:05.756072 --- ParallelTerminationStrategy: PID 25090 died... 13:14:05.776165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25090): Terminated: ok {rc=0} 13:14:05.863669 bus /sierra_3: Setting Powered False 13:14:06.961151 bus /sierra_3: Setting Powered False 13:14:08.076926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:14:09.310548 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:09.315975 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:14:09.336229 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:14:09.365460 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:14:09.420329 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:14:09.441786 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:14:09.470012 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:14:10.014062 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:14:10.063422 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.074413 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:14:10.131814 tst mo_mt_call.py: using LAC 34183 13:14:10.252430 tst mo_mt_call.py: using RAC 13 13:14:10.373450 tst mo_mt_call.py: using CellId 34183 13:14:10.493667 tst mo_mt_call.py: using BVCI 34184 13:14:10.606187 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.617116 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.627595 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.638265 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.648693 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:10.659266 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:10.779349 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:10.896732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:11.364077 run create_hlr_db(pid=25097): Launched 13:14:11.491061 bus /sierra_2: Setting Powered False 13:14:12.551504 run create_hlr_db(pid=25097): Terminated: ok {rc=0} 13:14:12.971360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Launched 13:14:13.272630 run osmo-hlr_10.42.42.2(pid=25100): Launched 13:14:13.386953 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:13.905694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Launched 13:14:14.209076 run osmo-stp_10.42.42.5(pid=25103): Launched 13:14:14.322906 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:14.869612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25105): Launched 13:14:15.175879 run osmo-msc_10.42.42.6(pid=25106): Launched 13:14:15.344389 run osmo-stp_10.42.42.5(pid=25103): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] 13:14:15.472625 run osmo-stp_10.42.42.5(pid=25103): stdout: | (launched: 2022-12-13_13:14:14.153466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:15.600668 run osmo-stp_10.42.42.5(pid=25103): stderr: | 20221213131414322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131414322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131414322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131414323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131414323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131414323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131414323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:15.726492 run osmo-stp_10.42.42.5(pid=25103): stdout: | (launched: 2022-12-13_13:14:14.153466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:15.863611 run osmo-stp_10.42.42.5(pid=25103): stderr: | 20221213131414322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131414322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131414322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131414323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131414323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131414323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131414323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:16.031836 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25103): Process ended prematurely: osmo-stp_10.42.42.5(pid=25103) [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:14:16.041805 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:14:16.069031 run osmo-hlr_10.42.42.2(pid=25100): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25100)] 13:14:16.117696 run osmo-hlr_10.42.42.2(pid=25100): stdout: | (launched: 2022-12-13_13:14:13.217274) 13:14:16.168641 run osmo-hlr_10.42.42.2(pid=25100): stderr: | 20221213131413389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131413389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131413389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131413389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131413389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131413389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131413402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131413411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131413411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131413411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:16.239276 run osmo-msc_10.42.42.6(pid=25106): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25106)] 13:14:16.287679 run osmo-msc_10.42.42.6(pid=25106): stdout: | (launched: 2022-12-13_13:14:15.119968) 13:14:16.337803 run osmo-msc_10.42.42.6(pid=25106): stderr: | 20221213131415391 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131415391 DLGLOBAL DEBUG validating counter group 0x7f204c88ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131415391 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131415391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131415392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131415392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131415393 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131415394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131415394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131415394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:16.388618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Terminating (SIGTERM) 13:14:16.429018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Terminating (SIGTERM) 13:14:16.469499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25105): Terminating (SIGTERM) 13:14:16.513796 --- ParallelTerminationStrategy: PID 25099 died... 13:14:16.533602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Terminated: ok {rc=0} 13:14:16.578805 --- ParallelTerminationStrategy: PID 25102 died... 13:14:16.598225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Terminated: ok {rc=0} 13:14:16.642591 --- ParallelTerminationStrategy: PID 25105 died... 13:14:16.661902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25105): Terminated: ok {rc=0} 13:14:16.748437 bus /sierra_3: Setting Powered False 13:14:17.848407 bus /sierra_3: Setting Powered False 13:14:18.964773 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:14:20.113643 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.125503 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:14:20.184175 tst mo_mt_call_osmux.py: using LAC 34184 13:14:20.313441 tst mo_mt_call_osmux.py: using RAC 14 13:14:20.442110 tst mo_mt_call_osmux.py: using CellId 34184 13:14:20.573271 tst mo_mt_call_osmux.py: using BVCI 34185 13:14:20.683326 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.694508 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.705419 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.716199 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.727276 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:20.738434 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:20.859233 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:20.975926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:21.481739 run create_hlr_db(pid=25108): Launched 13:14:21.607146 bus /sierra_2: Setting Powered False 13:14:22.670802 run create_hlr_db(pid=25108): Terminated: ok {rc=0} 13:14:23.102930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25110): Launched 13:14:23.406707 run osmo-hlr_10.42.42.2(pid=25111): Launched 13:14:23.521496 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:24.050631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25113): Launched 13:14:24.356866 run osmo-stp_10.42.42.5(pid=25114): Launched 13:14:24.471500 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:25.022729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25116): Launched 13:14:25.325939 run osmo-msc_10.42.42.6(pid=25117): Launched 13:14:25.494522 run osmo-stp_10.42.42.5(pid=25114): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25114)] 13:14:25.622202 run osmo-stp_10.42.42.5(pid=25114): stdout: | (launched: 2022-12-13_13:14:24.300823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:25.750291 run osmo-stp_10.42.42.5(pid=25114): stderr: | 20221213131424470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131424470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131424470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131424471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131424471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131424472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131424472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:25.876542 run osmo-stp_10.42.42.5(pid=25114): stdout: | (launched: 2022-12-13_13:14:24.300823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:25.996658 run osmo-stp_10.42.42.5(pid=25114): stderr: | 20221213131424470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131424470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131424470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131424471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131424471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131424472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131424472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:26.140679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25114): Process ended prematurely: osmo-stp_10.42.42.5(pid=25114) [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25114)] [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:14:26.149933 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:14:26.176368 run osmo-hlr_10.42.42.2(pid=25111): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25111)] 13:14:26.224440 run osmo-hlr_10.42.42.2(pid=25111): stdout: | (launched: 2022-12-13_13:14:23.351070) 13:14:26.273846 run osmo-hlr_10.42.42.2(pid=25111): stderr: | 20221213131423524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131423524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131423524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131423524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131423524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131423524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131423537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131423546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131423546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131423546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:26.342538 run osmo-msc_10.42.42.6(pid=25117): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25117)] 13:14:26.389657 run osmo-msc_10.42.42.6(pid=25117): stdout: | (launched: 2022-12-13_13:14:25.270322) 13:14:26.438262 run osmo-msc_10.42.42.6(pid=25117): stderr: | 20221213131425540 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131425541 DLGLOBAL DEBUG validating counter group 0x7f4fd505fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131425541 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131425541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131425541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131425541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131425543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131425543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131425544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131425544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:26.487451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25110): Terminating (SIGTERM) 13:14:26.526807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25113): Terminating (SIGTERM) 13:14:26.566153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25116): Terminating (SIGTERM) 13:14:26.605766 --- ParallelTerminationStrategy: PID 25110 died... 13:14:26.624943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25110): Terminated: ok {rc=0} 13:14:26.668652 --- ParallelTerminationStrategy: PID 25113 died... 13:14:26.687465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25113): Terminated: ok {rc=0} 13:14:26.731074 --- ParallelTerminationStrategy: PID 25116 died... 13:14:26.750330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25116): Terminated: ok {rc=0} 13:14:26.835722 bus /sierra_3: Setting Powered False 13:14:27.935325 bus /sierra_3: Setting Powered False 13:14:29.049151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:oc2g --------------------------------------------------------------------- 13:14:30.279620 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:30.283832 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 13:14:30.304125 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 13:14:30.330786 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 13:14:30.418654 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 13:14:30.439553 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 13:14:30.465851 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 13:14:31.059365 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 13:14:31.066399 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.080684 tst emergency:oc2g: Using 1 x bts (candidates: 1) 13:14:31.123740 tst emergency_mo_mt_call.py: using LAC 34185 13:14:31.252396 tst emergency_mo_mt_call.py: using RAC 15 13:14:31.382638 tst emergency_mo_mt_call.py: using CellId 34185 13:14:31.513332 tst emergency_mo_mt_call.py: using BVCI 34186 13:14:31.633404 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.645832 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.657786 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.671164 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.684168 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:31.696870 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:31.845233 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:31.972334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:32.435696 run create_hlr_db(pid=25122): Launched 13:14:32.557731 bus /sierra_2: Setting Powered False 13:14:33.616905 run create_hlr_db(pid=25122): Terminated: ok {rc=0} 13:14:34.053986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25124): Launched 13:14:34.374746 run osmo-hlr_10.42.42.2(pid=25125): Launched 13:14:34.496451 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:35.044669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25127): Launched 13:14:35.364012 run osmo-stp_10.42.42.5(pid=25128): Launched 13:14:35.495563 tst emergency_mo_mt_call.py: using MSISDN 8177 13:14:35.658926 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:36.233477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25130): Launched 13:14:36.556431 run osmo-msc_10.42.42.6(pid=25131): Launched 13:14:36.736151 run osmo-stp_10.42.42.5(pid=25128): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25128)] 13:14:36.871321 run osmo-stp_10.42.42.5(pid=25128): stdout: | (launched: 2022-12-13_13:14:35.305730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:37.008524 run osmo-stp_10.42.42.5(pid=25128): stderr: | 20221213131435493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131435493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131435494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131435494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131435495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131435495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131435495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:37.142925 run osmo-stp_10.42.42.5(pid=25128): stdout: | (launched: 2022-12-13_13:14:35.305730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:37.270343 run osmo-stp_10.42.42.5(pid=25128): stderr: | 20221213131435493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131435493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131435494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131435494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131435495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131435495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131435495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:37.422658 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25128): Process ended prematurely: osmo-stp_10.42.42.5(pid=25128) [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25128)] [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py:19] 13:14:37.431823 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:14:37.459411 run osmo-hlr_10.42.42.2(pid=25125): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25125)] 13:14:37.510395 run osmo-hlr_10.42.42.2(pid=25125): stdout: | (launched: 2022-12-13_13:14:34.316377) 13:14:37.561851 run osmo-hlr_10.42.42.2(pid=25125): stderr: | 20221213131434509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131434509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131434509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131434509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131434509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131434509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131434522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131434530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131434531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131434531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:37.633860 run osmo-msc_10.42.42.6(pid=25131): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25131)] 13:14:37.683701 run osmo-msc_10.42.42.6(pid=25131): stdout: | (launched: 2022-12-13_13:14:36.497761) 13:14:37.735861 run osmo-msc_10.42.42.6(pid=25131): stderr: | 20221213131436815 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131436815 DLGLOBAL DEBUG validating counter group 0x7efd5dbe9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131436815 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131436815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131436816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131436816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131436818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131436818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131436818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131436818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:37.788152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25124): Terminating (SIGTERM) 13:14:37.829793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25127): Terminating (SIGTERM) 13:14:37.871722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25130): Terminating (SIGTERM) 13:14:37.914287 --- ParallelTerminationStrategy: PID 25124 died... 13:14:37.934910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25124): Terminated: ok {rc=0} 13:14:37.981524 --- ParallelTerminationStrategy: PID 25127 died... 13:14:38.001433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25127): Terminated: ok {rc=0} 13:14:38.048208 --- ParallelTerminationStrategy: PID 25130 died... 13:14:38.068120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25130): Terminated: ok {rc=0} 13:14:38.156611 bus /sierra_3: Setting Powered False 13:14:39.256526 bus /sierra_3: Setting Powered False 13:14:40.374584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 13:14:41.462097 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:41.473377 tst emergency:oc2g: Using 1 x bts (candidates: 1) 13:14:41.511135 tst emergency_preemptive_call.py: using LAC 34186 13:14:41.628438 tst emergency_preemptive_call.py: using RAC 16 13:14:41.745424 tst emergency_preemptive_call.py: using CellId 34186 13:14:41.864828 tst emergency_preemptive_call.py: using BVCI 34187 13:14:41.972533 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:41.983072 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:41.993462 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:42.003790 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:42.014140 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:14:42.024381 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:42.141123 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:42.262333 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:42.378854 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:14:42.492699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:42.991727 run create_hlr_db(pid=25133): Launched 13:14:43.115466 bus /sierra_2: Setting Powered False 13:14:44.175423 run create_hlr_db(pid=25133): Terminated: ok {rc=0} 13:14:44.625148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25135): Launched 13:14:44.945320 run osmo-hlr_10.42.42.2(pid=25136): Launched 13:14:45.067270 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:45.615615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25138): Launched 13:14:45.959552 run osmo-stp_10.42.42.5(pid=25139): Launched 13:14:46.333585 tst emergency_preemptive_call.py: using MSISDN 8178 13:14:46.502809 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:47.084913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25141): Launched 13:14:47.419999 run osmo-msc_10.42.42.6(pid=25142): Launched 13:14:47.598729 run osmo-stp_10.42.42.5(pid=25139): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25139)] 13:14:47.734095 run osmo-stp_10.42.42.5(pid=25139): stdout: | (launched: 2022-12-13_13:14:45.889200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:47.870292 run osmo-stp_10.42.42.5(pid=25139): stderr: | 20221213131446142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131446143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131446143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131446145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131446145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131446145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131446145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:48.004213 run osmo-stp_10.42.42.5(pid=25139): stdout: | (launched: 2022-12-13_13:14:45.889200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:48.131571 run osmo-stp_10.42.42.5(pid=25139): stderr: | 20221213131446142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131446143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131446143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131446145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131446145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131446145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131446145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:48.283742 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25139): Process ended prematurely: osmo-stp_10.42.42.5(pid=25139) [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25139)] [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py:32] 13:14:48.292910 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 13:14:48.320653 run osmo-hlr_10.42.42.2(pid=25136): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25136)] 13:14:48.371856 run osmo-hlr_10.42.42.2(pid=25136): stdout: | (launched: 2022-12-13_13:14:44.886709) 13:14:48.424107 run osmo-hlr_10.42.42.2(pid=25136): stderr: | 20221213131445079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131445079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131445079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131445079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131445080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131445080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131445092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131445100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131445101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131445101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:48.496813 run osmo-msc_10.42.42.6(pid=25142): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25142)] 13:14:48.546998 run osmo-msc_10.42.42.6(pid=25142): stdout: | (launched: 2022-12-13_13:14:47.361752) 13:14:48.599065 run osmo-msc_10.42.42.6(pid=25142): stderr: | 20221213131447680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131447680 DLGLOBAL DEBUG validating counter group 0x7fb7d748ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131447680 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131447680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131447681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131447681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131447683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131447683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131447683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131447683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:48.651566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25135): Terminating (SIGTERM) 13:14:48.693139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25138): Terminating (SIGTERM) 13:14:48.735313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25141): Terminating (SIGTERM) 13:14:48.777836 --- ParallelTerminationStrategy: PID 25135 died... 13:14:48.798224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25135): Terminated: ok {rc=0} 13:14:48.844671 --- ParallelTerminationStrategy: PID 25138 died... 13:14:48.864758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25138): Terminated: ok {rc=0} 13:14:48.910810 --- ParallelTerminationStrategy: PID 25141 died... 13:14:48.930692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25141): Terminated: ok {rc=0} 13:14:49.018576 bus /sierra_9: Setting Powered False 13:14:50.114901 bus /sierra_9: Setting Powered False 13:14:51.230154 bus /sierra_8: Setting Powered False 13:14:52.324018 bus /sierra_8: Setting Powered False 13:14:53.439007 bus /sierra_3: Setting Powered False 13:14:54.538331 bus /sierra_3: Setting Powered False 13:14:55.651808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:oc2g --------------------------------------------------------------------- 13:14:56.916896 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:56.921707 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 13:14:56.942865 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 13:14:56.983588 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 13:14:57.072492 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 13:14:57.093962 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 13:14:57.133742 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 13:14:57.723368 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 13:14:57.777215 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:57.788202 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:14:57.824046 tst cs_paging_gprs_active.py: using LAC 34187 13:14:57.955071 tst cs_paging_gprs_active.py: using RAC 17 13:14:58.076554 tst cs_paging_gprs_active.py: using CellId 34187 13:14:58.196624 tst cs_paging_gprs_active.py: using BVCI 34188 13:14:58.309520 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.320050 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.330596 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.341055 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.351621 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.362017 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.372403 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.382726 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:14:58.393748 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:14:58.514990 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:14:58.633439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:14:58.837330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:59.142347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25147): Launched 13:14:59.410579 run iperf3-srv_10.42.42.10(pid=25148): Launched 13:14:59.524798 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:14:59.727479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:00.032567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25149): Launched 13:15:00.297834 run iperf3-srv_10.42.42.10(pid=25150): Launched 13:15:00.412544 tst cs_paging_gprs_active.py:38: start network... 13:15:00.617540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:01.104688 run create_hlr_db(pid=25151): Launched 13:15:01.262726 bus /sierra_2: Setting Powered False 13:15:02.327251 run create_hlr_db(pid=25151): Terminated: ok {rc=0} 13:15:02.761057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Launched 13:15:03.063927 run osmo-hlr_10.42.42.2(pid=25157): Launched 13:15:03.179195 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:03.704912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Launched 13:15:04.006380 run osmo-stp_10.42.42.5(pid=25160): Launched 13:15:04.121282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:04.644859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25162): Launched 13:15:04.761098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:05.018240 run patchelf(pid=25163): Launched 13:15:05.187522 run osmo-stp_10.42.42.5(pid=25160): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] 13:15:05.316350 run osmo-stp_10.42.42.5(pid=25160): stdout: | (launched: 2022-12-13_13:15:03.950680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:05.446688 run osmo-stp_10.42.42.5(pid=25160): stderr: | 20221213131504118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131504118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131504118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131504119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131504119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131504119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131504119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:05.576936 run osmo-stp_10.42.42.5(pid=25160): stdout: | (launched: 2022-12-13_13:15:03.950680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:05.700907 run osmo-stp_10.42.42.5(pid=25160): stderr: | 20221213131504118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131504118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131504118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131504119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131504119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131504119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131504119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:05.848248 run patchelf(pid=25163): Terminating (SIGINT) 13:15:06.019635 run patchelf(pid=25163): Terminated: ok {rc=0} 13:15:06.143334 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25160): Process ended prematurely: osmo-stp_10.42.42.5(pid=25160) [trial-2390↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] [trial-2390↪gprs:oc2g↪cs_paging_gprs_active.py:38] 13:15:06.152591 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:15:06.179827 run osmo-hlr_10.42.42.2(pid=25157): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25157)] 13:15:06.227759 run osmo-hlr_10.42.42.2(pid=25157): stdout: | (launched: 2022-12-13_13:15:03.008485) 13:15:06.277101 run osmo-hlr_10.42.42.2(pid=25157): stderr: | 20221213131503182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131503182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131503182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131503183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131503183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131503183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131503195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131503206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131503206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131503206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:06.326799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25147): Terminating (SIGTERM) 13:15:06.366103 run iperf3-srv_10.42.42.10(pid=25148): Terminating (SIGTERM) 13:15:06.405277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25149): Terminating (SIGTERM) 13:15:06.444567 run iperf3-srv_10.42.42.10(pid=25150): Terminating (SIGTERM) 13:15:06.483678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Terminating (SIGTERM) 13:15:06.523071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Terminating (SIGTERM) 13:15:06.562888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25162): Terminating (SIGTERM) 13:15:06.602467 --- ParallelTerminationStrategy: PID 25147 died... 13:15:06.621528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25147): Terminated: ok {rc=0} 13:15:06.665039 --- ParallelTerminationStrategy: PID 25148 died... 13:15:06.683649 run iperf3-srv_10.42.42.10(pid=25148): Terminated {rc=256} 13:15:06.726995 --- ParallelTerminationStrategy: PID 25149 died... 13:15:06.745600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25149): Terminated: ok {rc=0} 13:15:06.789085 --- ParallelTerminationStrategy: PID 25150 died... 13:15:06.807572 run iperf3-srv_10.42.42.10(pid=25150): Terminated {rc=256} 13:15:06.850823 --- ParallelTerminationStrategy: PID 25156 died... 13:15:06.869522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25156): Terminated: ok {rc=0} 13:15:06.913036 --- ParallelTerminationStrategy: PID 25159 died... 13:15:06.931746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25159): Terminated: ok {rc=0} 13:15:06.975157 --- ParallelTerminationStrategy: PID 25162 died... 13:15:06.993795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25162): Terminated: ok {rc=0} 13:15:07.078737 bus /gobi_0: Setting Powered False 13:15:08.176209 bus /gobi_0: Setting Powered False 13:15:09.290414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g iperf3.py ---------------------------------------------- 13:15:10.436401 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:10.447358 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:15:10.482466 tst iperf3.py: using LAC 34188 13:15:10.603388 tst iperf3.py: using RAC 18 13:15:10.725189 tst iperf3.py: using CellId 34188 13:15:10.845685 tst iperf3.py: using BVCI 34189 13:15:10.955153 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:10.965597 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:10.975891 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:10.986143 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:10.996261 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:11.006945 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:11.017739 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:11.028354 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:11.038941 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:11.161778 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:11.383488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:11.712043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25164): Launched 13:15:11.997558 run iperf3-srv_10.42.42.10(pid=25165): Launched 13:15:12.122132 tst iperf3.py:8: start network... 13:15:12.344787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:12.856537 run create_hlr_db(pid=25166): Launched 13:15:12.984011 bus /gobi_6: Setting Powered False 13:15:14.049279 run create_hlr_db(pid=25166): Terminated: ok {rc=0} 13:15:14.486202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25168): Launched 13:15:14.792562 run osmo-hlr_10.42.42.2(pid=25169): Launched 13:15:14.908050 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:15.435753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25171): Launched 13:15:15.740123 run osmo-stp_10.42.42.5(pid=25172): Launched 13:15:15.873103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:16.560102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25174): Launched 13:15:16.691558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:16.953113 run patchelf(pid=25175): Launched 13:15:17.140276 run osmo-stp_10.42.42.5(pid=25172): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25172)] 13:15:17.270604 run osmo-stp_10.42.42.5(pid=25172): stdout: | (launched: 2022-12-13_13:15:15.684037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:17.400919 run osmo-stp_10.42.42.5(pid=25172): stderr: | 20221213131515891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131515891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131515891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131515892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131515892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131515893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131515893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:17.531866 run osmo-stp_10.42.42.5(pid=25172): stdout: | (launched: 2022-12-13_13:15:15.684037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:17.656279 run osmo-stp_10.42.42.5(pid=25172): stderr: | 20221213131515891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131515891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131515891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131515892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131515892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131515893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131515893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:17.804242 run patchelf(pid=25175): Terminating (SIGINT) 13:15:17.977693 run patchelf(pid=25175): Terminated: ok {rc=0} 13:15:18.100886 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25172): Process ended prematurely: osmo-stp_10.42.42.5(pid=25172) [trial-2390↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25172)] [trial-2390↪gprs:oc2g↪iperf3.py:8] 13:15:18.110774 tst iperf3.py:8: Test FAILED (7.7 sec) 13:15:18.137744 run osmo-hlr_10.42.42.2(pid=25169): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25169)] 13:15:18.184858 run osmo-hlr_10.42.42.2(pid=25169): stdout: | (launched: 2022-12-13_13:15:14.736257) 13:15:18.233665 run osmo-hlr_10.42.42.2(pid=25169): stderr: | 20221213131514911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131514911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131514911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131514911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131514911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131514911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131514923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131514932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131514932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131514932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:18.282927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25164): Terminating (SIGTERM) 13:15:18.322298 run iperf3-srv_10.42.42.10(pid=25165): Terminating (SIGTERM) 13:15:18.361461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25168): Terminating (SIGTERM) 13:15:18.400826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25171): Terminating (SIGTERM) 13:15:18.440154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25174): Terminating (SIGTERM) 13:15:18.479767 --- ParallelTerminationStrategy: PID 25164 died... 13:15:18.498947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25164): Terminated: ok {rc=0} 13:15:18.542609 --- ParallelTerminationStrategy: PID 25165 died... 13:15:18.561355 run iperf3-srv_10.42.42.10(pid=25165): Terminated {rc=256} 13:15:18.604904 --- ParallelTerminationStrategy: PID 25168 died... 13:15:18.623791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25168): Terminated: ok {rc=0} 13:15:18.668039 --- ParallelTerminationStrategy: PID 25171 died... 13:15:18.686882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25171): Terminated: ok {rc=0} 13:15:18.730515 --- ParallelTerminationStrategy: PID 25174 died... 13:15:18.749336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25174): Terminated: ok {rc=0} 13:15:18.834342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g iperf3m4.py ---------------------------------------------- 13:15:19.979583 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:19.990803 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:15:20.026455 tst iperf3m4.py: using LAC 34189 13:15:20.147295 tst iperf3m4.py: using RAC 19 13:15:20.269587 tst iperf3m4.py: using CellId 34189 13:15:20.391624 tst iperf3m4.py: using BVCI 34190 13:15:20.503971 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.514420 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.524828 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.535430 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.545623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.559729 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.571283 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.582856 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:20.594410 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:20.712007 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:20.834615 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:20.952021 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:21.068524 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:21.272437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:21.579516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Launched 13:15:21.848185 run iperf3-srv_10.42.42.10(pid=25178): Launched 13:15:21.962709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:15:22.166707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:22.472441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25179): Launched 13:15:22.737686 run iperf3-srv_10.42.42.10(pid=25180): Launched 13:15:22.852440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:15:23.056421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:23.362902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25181): Launched 13:15:23.630018 run iperf3-srv_10.42.42.10(pid=25182): Launched 13:15:23.746308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:15:23.950111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:24.255457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25183): Launched 13:15:24.519472 run iperf3-srv_10.42.42.10(pid=25184): Launched 13:15:24.632941 tst iperf3m4.py:8: start network... 13:15:24.835979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:25.306413 run create_hlr_db(pid=25185): Launched 13:15:25.431189 bus /gobi_6: Setting Powered False 13:15:26.491728 run create_hlr_db(pid=25185): Terminated: ok {rc=0} 13:15:26.936098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25187): Launched 13:15:27.263096 run osmo-hlr_10.42.42.2(pid=25188): Launched 13:15:27.389086 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:27.951735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25190): Launched 13:15:28.279905 run osmo-stp_10.42.42.5(pid=25191): Launched 13:15:28.405501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:28.975594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25193): Launched 13:15:29.102472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:29.382750 run patchelf(pid=25194): Launched 13:15:29.568235 run osmo-stp_10.42.42.5(pid=25191): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25191)] 13:15:29.707880 run osmo-stp_10.42.42.5(pid=25191): stdout: | (launched: 2022-12-13_13:15:28.219517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:29.849269 run osmo-stp_10.42.42.5(pid=25191): stderr: | 20221213131528406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131528406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131528407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131528407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131528408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131528408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131528408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:29.991673 run osmo-stp_10.42.42.5(pid=25191): stdout: | (launched: 2022-12-13_13:15:28.219517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:30.127444 run osmo-stp_10.42.42.5(pid=25191): stderr: | 20221213131528406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131528406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131528407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131528407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131528408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131528408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131528408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:30.288362 run patchelf(pid=25194): Terminating (SIGINT) 13:15:30.474488 run patchelf(pid=25194): Terminated: ok {rc=0} 13:15:30.609270 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25191): Process ended prematurely: osmo-stp_10.42.42.5(pid=25191) [trial-2390↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25191)] [trial-2390↪gprs:oc2g↪iperf3m4.py:8] 13:15:30.619848 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:15:30.648866 run osmo-hlr_10.42.42.2(pid=25188): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25188)] 13:15:30.699422 run osmo-hlr_10.42.42.2(pid=25188): stdout: | (launched: 2022-12-13_13:15:27.203306) 13:15:30.751540 run osmo-hlr_10.42.42.2(pid=25188): stderr: | 20221213131527397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131527397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131527397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131527397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131527397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131527397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131527412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131527422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131527423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131527423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:30.803994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Terminating (SIGTERM) 13:15:30.858843 run iperf3-srv_10.42.42.10(pid=25178): Terminating (SIGTERM) 13:15:30.927033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25179): Terminating (SIGTERM) 13:15:30.970090 run iperf3-srv_10.42.42.10(pid=25180): Terminating (SIGTERM) 13:15:31.015957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25181): Terminating (SIGTERM) 13:15:31.085749 run iperf3-srv_10.42.42.10(pid=25182): Terminating (SIGTERM) 13:15:31.131123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25183): Terminating (SIGTERM) 13:15:31.175091 run iperf3-srv_10.42.42.10(pid=25184): Terminating (SIGTERM) 13:15:31.221119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25187): Terminating (SIGTERM) 13:15:31.264481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25190): Terminating (SIGTERM) 13:15:31.308110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25193): Terminating (SIGTERM) 13:15:31.353281 --- ParallelTerminationStrategy: PID 25177 died... 13:15:31.374035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Terminated: ok {rc=0} 13:15:31.421600 --- ParallelTerminationStrategy: PID 25178 died... 13:15:31.442204 run iperf3-srv_10.42.42.10(pid=25178): Terminated {rc=256} 13:15:31.489808 --- ParallelTerminationStrategy: PID 25179 died... 13:15:31.510356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25179): Terminated: ok {rc=0} 13:15:31.557935 --- ParallelTerminationStrategy: PID 25180 died... 13:15:31.578081 run iperf3-srv_10.42.42.10(pid=25180): Terminated {rc=256} 13:15:31.625991 --- ParallelTerminationStrategy: PID 25181 died... 13:15:31.646663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25181): Terminated: ok {rc=0} 13:15:31.693900 --- ParallelTerminationStrategy: PID 25182 died... 13:15:31.714423 run iperf3-srv_10.42.42.10(pid=25182): Terminated {rc=256} 13:15:31.761765 --- ParallelTerminationStrategy: PID 25183 died... 13:15:31.782310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25183): Terminated: ok {rc=0} 13:15:31.829797 --- ParallelTerminationStrategy: PID 25184 died... 13:15:31.850233 run iperf3-srv_10.42.42.10(pid=25184): Terminated {rc=256} 13:15:31.897914 --- ParallelTerminationStrategy: PID 25187 died... 13:15:31.918644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25187): Terminated: ok {rc=0} 13:15:31.965967 --- ParallelTerminationStrategy: PID 25190 died... 13:15:31.986652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25190): Terminated: ok {rc=0} 13:15:32.033928 --- ParallelTerminationStrategy: PID 25193 died... 13:15:32.054669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25193): Terminated: ok {rc=0} 13:15:32.156647 bus /gobi_4: Setting Powered False 13:15:33.263046 bus /gobi_4: Setting Powered False 13:15:34.377367 bus /gobi_1: Setting Powered False 13:15:35.474581 bus /gobi_1: Setting Powered False 13:15:36.590318 bus /gobi_0: Setting Powered False 13:15:37.689149 bus /gobi_0: Setting Powered False 13:15:38.805938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g ping.py ---------------------------------------------- 13:15:39.908856 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:39.920640 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:15:39.956641 tst ping.py: using LAC 34190 13:15:40.084941 tst ping.py: using RAC 20 13:15:40.213575 tst ping.py: using CellId 34190 13:15:40.333428 tst ping.py: using BVCI 34191 13:15:40.443171 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.453863 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.464263 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.474665 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.484856 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.495682 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.507445 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:40.518350 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:40.638012 tst ping.py:19: start network... 13:15:40.842413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:41.310461 run create_hlr_db(pid=25195): Launched 13:15:41.435618 bus /gobi_6: Setting Powered False 13:15:42.496806 run create_hlr_db(pid=25195): Terminated: ok {rc=0} 13:15:42.941529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Launched 13:15:43.269322 run osmo-hlr_10.42.42.2(pid=25198): Launched 13:15:43.393710 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:43.959260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Launched 13:15:44.286778 run osmo-stp_10.42.42.5(pid=25201): Launched 13:15:44.412762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:44.973653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25203): Launched 13:15:45.099185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:45.375464 run patchelf(pid=25204): Launched 13:15:45.558870 run osmo-stp_10.42.42.5(pid=25201): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] 13:15:45.696361 run osmo-stp_10.42.42.5(pid=25201): stdout: | (launched: 2022-12-13_13:15:44.226395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:45.842110 run osmo-stp_10.42.42.5(pid=25201): stderr: | 20221213131544415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131544416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131544416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131544416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131544417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131544417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131544417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:45.992287 run osmo-stp_10.42.42.5(pid=25201): stdout: | (launched: 2022-12-13_13:15:44.226395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:46.129737 run osmo-stp_10.42.42.5(pid=25201): stderr: | 20221213131544415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131544416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131544416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131544416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131544417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131544417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131544417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:46.291635 run patchelf(pid=25204): Terminating (SIGINT) 13:15:46.478569 run patchelf(pid=25204): Terminated: ok {rc=0} 13:15:46.613853 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25201): Process ended prematurely: osmo-stp_10.42.42.5(pid=25201) [trial-2390↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] [trial-2390↪gprs:oc2g↪ping.py:22] 13:15:46.624477 tst ping.py:22: Test FAILED (6.7 sec) 13:15:46.654472 run osmo-hlr_10.42.42.2(pid=25198): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25198)] 13:15:46.709334 run osmo-hlr_10.42.42.2(pid=25198): stdout: | (launched: 2022-12-13_13:15:43.209108) 13:15:46.763399 run osmo-hlr_10.42.42.2(pid=25198): stderr: | 20221213131543405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131543406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131543406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131543406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131543406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131543406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131543421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131543431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131543431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131543431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:46.818745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Terminating (SIGTERM) 13:15:46.863087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Terminating (SIGTERM) 13:15:46.909738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25203): Terminating (SIGTERM) 13:15:46.956328 --- ParallelTerminationStrategy: PID 25197 died... 13:15:46.978615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Terminated: ok {rc=0} 13:15:47.027381 --- ParallelTerminationStrategy: PID 25200 died... 13:15:47.049434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Terminated: ok {rc=0} 13:15:47.098124 --- ParallelTerminationStrategy: PID 25203 died... 13:15:47.119897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25203): Terminated: ok {rc=0} 13:15:47.211522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 13:15:48.298503 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.310237 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:15:48.354610 tst ping_idle_ping.py: using LAC 34191 13:15:48.482226 tst ping_idle_ping.py: using RAC 21 13:15:48.608554 tst ping_idle_ping.py: using CellId 34191 13:15:48.734480 tst ping_idle_ping.py: using BVCI 34192 13:15:48.854477 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.865496 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.876356 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.887220 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.898441 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.909605 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.920751 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:15:48.931855 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:15:49.048456 tst ping_idle_ping.py:24: start network... 13:15:49.251580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:49.724801 run create_hlr_db(pid=25205): Launched 13:15:49.850220 bus /gobi_6: Setting Powered False 13:15:50.911596 run create_hlr_db(pid=25205): Terminated: ok {rc=0} 13:15:51.335273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Launched 13:15:51.638630 run osmo-hlr_10.42.42.2(pid=25208): Launched 13:15:51.752673 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:52.281111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Launched 13:15:52.584540 run osmo-stp_10.42.42.5(pid=25214): Launched 13:15:52.700044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:53.222989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Launched 13:15:53.340353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:53.597592 run patchelf(pid=25217): Launched 13:15:53.768072 run osmo-stp_10.42.42.5(pid=25214): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] 13:15:53.897805 run osmo-stp_10.42.42.5(pid=25214): stdout: | (launched: 2022-12-13_13:15:52.528170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:54.028210 run osmo-stp_10.42.42.5(pid=25214): stderr: | 20221213131552697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131552697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131552697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131552698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131552698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131552698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131552698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:54.158978 run osmo-stp_10.42.42.5(pid=25214): stdout: | (launched: 2022-12-13_13:15:52.528170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:54.282626 run osmo-stp_10.42.42.5(pid=25214): stderr: | 20221213131552697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131552697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131552697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131552698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131552698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131552698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131552698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:54.430261 run patchelf(pid=25217): Terminating (SIGINT) 13:15:54.601973 run patchelf(pid=25217): Terminated: ok {rc=0} 13:15:54.725182 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25214): Process ended prematurely: osmo-stp_10.42.42.5(pid=25214) [trial-2390↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] [trial-2390↪gprs:oc2g↪ping_idle_ping.py:27] 13:15:54.734135 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:15:54.760796 run osmo-hlr_10.42.42.2(pid=25208): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25208)] 13:15:54.808524 run osmo-hlr_10.42.42.2(pid=25208): stdout: | (launched: 2022-12-13_13:15:51.582315) 13:15:54.857482 run osmo-hlr_10.42.42.2(pid=25208): stderr: | 20221213131551756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131551756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131551756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131551756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131551756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131551756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131551768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131551777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131551777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131551777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:54.906953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Terminating (SIGTERM) 13:15:54.947155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Terminating (SIGTERM) 13:15:54.987015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Terminating (SIGTERM) 13:15:55.027223 --- ParallelTerminationStrategy: PID 25207 died... 13:15:55.046446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25207): Terminated: ok {rc=0} 13:15:55.090478 --- ParallelTerminationStrategy: PID 25213 died... 13:15:55.109179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Terminated: ok {rc=0} 13:15:55.153194 --- ParallelTerminationStrategy: PID 25216 died... 13:15:55.171762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Terminated: ok {rc=0} 13:15:55.257250 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 13:15:56.547261 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:56.552378 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:15:56.572631 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:15:56.610990 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:15:56.697371 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:15:56.717722 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:15:56.755522 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:15:57.347962 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:15:57.396368 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.406969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:15:57.443121 tst cs_paging_gprs_active.py: using LAC 34192 13:15:57.563919 tst cs_paging_gprs_active.py: using RAC 22 13:15:57.685463 tst cs_paging_gprs_active.py: using CellId 34192 13:15:57.813749 tst cs_paging_gprs_active.py: using BVCI 34193 13:15:57.935183 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.946620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.957826 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.968893 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.980399 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:57.991578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:58.003159 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:58.014558 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:15:58.026094 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:15:58.144174 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:15:58.265085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:15:58.469968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:58.776108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25222): Launched 13:15:59.042208 run iperf3-srv_10.42.42.10(pid=25223): Launched 13:15:59.157757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:15:59.359772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:59.664509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25224): Launched 13:15:59.929787 run iperf3-srv_10.42.42.10(pid=25225): Launched 13:16:00.043858 tst cs_paging_gprs_active.py:38: start network... 13:16:00.247541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:00.722564 run create_hlr_db(pid=25226): Launched 13:16:00.868681 bus /gobi_6: Setting Powered False 13:16:01.943703 run create_hlr_db(pid=25226): Terminated: ok {rc=0} 13:16:02.436928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25228): Launched 13:16:02.741363 run osmo-hlr_10.42.42.2(pid=25229): Launched 13:16:02.855960 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:03.395923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25231): Launched 13:16:03.699780 run osmo-stp_10.42.42.5(pid=25232): Launched 13:16:03.815320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:04.339388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25234): Launched 13:16:04.455369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:04.711653 run patchelf(pid=25235): Launched 13:16:04.880120 run osmo-stp_10.42.42.5(pid=25232): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25232)] 13:16:05.008754 run osmo-stp_10.42.42.5(pid=25232): stdout: | (launched: 2022-12-13_13:16:03.643759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:05.138733 run osmo-stp_10.42.42.5(pid=25232): stderr: | 20221213131603811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131603811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131603811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131603812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131603812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131603812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131603812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:05.268186 run osmo-stp_10.42.42.5(pid=25232): stdout: | (launched: 2022-12-13_13:16:03.643759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:05.391732 run osmo-stp_10.42.42.5(pid=25232): stderr: | 20221213131603811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131603811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131603811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131603812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131603812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131603812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131603812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:05.538115 run patchelf(pid=25235): Terminating (SIGINT) 13:16:05.708145 run patchelf(pid=25235): Terminated: ok {rc=0} 13:16:05.831057 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25232): Process ended prematurely: osmo-stp_10.42.42.5(pid=25232) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25232)] [trial-2390↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:16:05.840482 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:16:05.867324 run osmo-hlr_10.42.42.2(pid=25229): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25229)] 13:16:05.914762 run osmo-hlr_10.42.42.2(pid=25229): stdout: | (launched: 2022-12-13_13:16:02.685245) 13:16:05.963857 run osmo-hlr_10.42.42.2(pid=25229): stderr: | 20221213131602860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131602860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131602860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131602860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131602860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131602860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131602873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131602881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131602882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131602882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:06.013555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25222): Terminating (SIGTERM) 13:16:06.053163 run iperf3-srv_10.42.42.10(pid=25223): Terminating (SIGTERM) 13:16:06.092752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25224): Terminating (SIGTERM) 13:16:06.132309 run iperf3-srv_10.42.42.10(pid=25225): Terminating (SIGTERM) 13:16:06.171791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25228): Terminating (SIGTERM) 13:16:06.211357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25231): Terminating (SIGTERM) 13:16:06.250919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25234): Terminating (SIGTERM) 13:16:06.290641 --- ParallelTerminationStrategy: PID 25222 died... 13:16:06.309572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25222): Terminated: ok {rc=0} 13:16:06.353343 --- ParallelTerminationStrategy: PID 25223 died... 13:16:06.371548 run iperf3-srv_10.42.42.10(pid=25223): Terminated {rc=256} 13:16:06.414832 --- ParallelTerminationStrategy: PID 25224 died... 13:16:06.433082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25224): Terminated: ok {rc=0} 13:16:06.476266 --- ParallelTerminationStrategy: PID 25225 died... 13:16:06.494641 run iperf3-srv_10.42.42.10(pid=25225): Terminated {rc=256} 13:16:06.537958 --- ParallelTerminationStrategy: PID 25228 died... 13:16:06.556343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25228): Terminated: ok {rc=0} 13:16:06.599722 --- ParallelTerminationStrategy: PID 25231 died... 13:16:06.618167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25231): Terminated: ok {rc=0} 13:16:06.661781 --- ParallelTerminationStrategy: PID 25234 died... 13:16:06.680451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25234): Terminated: ok {rc=0} 13:16:06.765834 bus /gobi_0: Setting Powered False 13:16:07.866275 bus /gobi_0: Setting Powered False 13:16:08.981121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:16:10.131442 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.143433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:10.181373 tst iperf3.py: using LAC 34193 13:16:10.301338 tst iperf3.py: using RAC 23 13:16:10.421268 tst iperf3.py: using CellId 34193 13:16:10.540149 tst iperf3.py: using BVCI 34194 13:16:10.651573 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.662325 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.672866 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.683417 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.693837 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.704775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.715793 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.726360 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:10.737012 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:10.859536 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:11.079371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:11.405598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25237): Launched 13:16:11.690512 run iperf3-srv_10.42.42.10(pid=25238): Launched 13:16:11.814646 tst iperf3.py:8: start network... 13:16:12.033817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:12.537271 run create_hlr_db(pid=25239): Launched 13:16:12.664446 bus /gobi_6: Setting Powered False 13:16:13.723921 run create_hlr_db(pid=25239): Terminated: ok {rc=0} 13:16:14.155525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Launched 13:16:14.459404 run osmo-hlr_10.42.42.2(pid=25242): Launched 13:16:14.575170 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:15.115555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Launched 13:16:15.423170 run osmo-stp_10.42.42.5(pid=25245): Launched 13:16:15.539737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:16.069924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25247): Launched 13:16:16.209086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:16.501748 run patchelf(pid=25248): Launched 13:16:16.677867 run osmo-stp_10.42.42.5(pid=25245): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] 13:16:16.808717 run osmo-stp_10.42.42.5(pid=25245): stdout: | (launched: 2022-12-13_13:16:15.366590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:16.941964 run osmo-stp_10.42.42.5(pid=25245): stderr: | 20221213131615535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131615535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131615535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131615536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131615536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131615536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131615536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:17.075117 run osmo-stp_10.42.42.5(pid=25245): stdout: | (launched: 2022-12-13_13:16:15.366590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:17.202395 run osmo-stp_10.42.42.5(pid=25245): stderr: | 20221213131615535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131615535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131615535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131615536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131615536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131615536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131615536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:17.350187 run patchelf(pid=25248): Terminating (SIGINT) 13:16:17.521515 run patchelf(pid=25248): Terminated: ok {rc=0} 13:16:17.644926 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25245): Process ended prematurely: osmo-stp_10.42.42.5(pid=25245) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 13:16:17.654892 tst iperf3.py:8: Test FAILED (7.6 sec) 13:16:17.682191 run osmo-hlr_10.42.42.2(pid=25242): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25242)] 13:16:17.730299 run osmo-hlr_10.42.42.2(pid=25242): stdout: | (launched: 2022-12-13_13:16:14.403396) 13:16:17.779973 run osmo-hlr_10.42.42.2(pid=25242): stderr: | 20221213131614576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131614576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131614576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131614576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131614577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131614577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131614589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131614598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131614598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131614598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:17.830163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25237): Terminating (SIGTERM) 13:16:17.870569 run iperf3-srv_10.42.42.10(pid=25238): Terminating (SIGTERM) 13:16:17.910886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Terminating (SIGTERM) 13:16:17.951385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Terminating (SIGTERM) 13:16:17.991920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25247): Terminating (SIGTERM) 13:16:18.032572 --- ParallelTerminationStrategy: PID 25237 died... 13:16:18.051931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25237): Terminated: ok {rc=0} 13:16:18.097177 --- ParallelTerminationStrategy: PID 25238 died... 13:16:18.116138 run iperf3-srv_10.42.42.10(pid=25238): Terminated {rc=256} 13:16:18.160740 --- ParallelTerminationStrategy: PID 25241 died... 13:16:18.179705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25241): Terminated: ok {rc=0} 13:16:18.224271 --- ParallelTerminationStrategy: PID 25244 died... 13:16:18.243425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25244): Terminated: ok {rc=0} 13:16:18.288003 --- ParallelTerminationStrategy: PID 25247 died... 13:16:18.307086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25247): Terminated: ok {rc=0} 13:16:18.394419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:16:19.541888 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:19.553255 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:19.590887 tst iperf3m4.py: using LAC 34194 13:16:19.720238 tst iperf3m4.py: using RAC 24 13:16:19.849113 tst iperf3m4.py: using CellId 34194 13:16:19.978498 tst iperf3m4.py: using BVCI 34195 13:16:20.098419 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.109954 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.121257 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.132277 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.143515 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.154801 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.166421 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.177665 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:20.188924 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:20.307898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:20.428458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:20.546697 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:20.666961 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:20.886377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:21.214262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25249): Launched 13:16:21.498144 run iperf3-srv_10.42.42.10(pid=25250): Launched 13:16:21.622879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:16:21.842268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:22.169144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25251): Launched 13:16:22.451633 run iperf3-srv_10.42.42.10(pid=25252): Launched 13:16:22.574594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:16:22.794176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:23.121089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25253): Launched 13:16:23.404630 run iperf3-srv_10.42.42.10(pid=25254): Launched 13:16:23.527667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:16:23.746771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:24.073875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25255): Launched 13:16:24.357965 run iperf3-srv_10.42.42.10(pid=25256): Launched 13:16:24.480262 tst iperf3m4.py:8: start network... 13:16:24.699882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:25.206570 run create_hlr_db(pid=25257): Launched 13:16:25.332631 bus /gobi_6: Setting Powered False 13:16:26.397117 run create_hlr_db(pid=25257): Terminated: ok {rc=0} 13:16:26.849994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25259): Launched 13:16:27.178240 run osmo-hlr_10.42.42.2(pid=25260): Launched 13:16:27.304599 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:27.867380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25262): Launched 13:16:28.194494 run osmo-stp_10.42.42.5(pid=25264): Launched 13:16:28.319045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:28.880566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25266): Launched 13:16:29.007847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:29.285598 run patchelf(pid=25267): Launched 13:16:29.468517 run osmo-stp_10.42.42.5(pid=25264): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25264)] 13:16:29.608149 run osmo-stp_10.42.42.5(pid=25264): stdout: | (launched: 2022-12-13_13:16:28.134568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:29.748695 run osmo-stp_10.42.42.5(pid=25264): stderr: | 20221213131628323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131628323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131628324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131628324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131628325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131628325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131628325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:29.889125 run osmo-stp_10.42.42.5(pid=25264): stdout: | (launched: 2022-12-13_13:16:28.134568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:30.024024 run osmo-stp_10.42.42.5(pid=25264): stderr: | 20221213131628323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131628323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131628324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131628324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131628325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131628325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131628325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:30.183857 run patchelf(pid=25267): Terminating (SIGINT) 13:16:30.368458 run patchelf(pid=25267): Terminated: ok {rc=0} 13:16:30.501539 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25264): Process ended prematurely: osmo-stp_10.42.42.5(pid=25264) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25264)] [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 13:16:30.511920 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:16:30.541444 run osmo-hlr_10.42.42.2(pid=25260): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25260)] 13:16:30.592927 run osmo-hlr_10.42.42.2(pid=25260): stdout: | (launched: 2022-12-13_13:16:27.117842) 13:16:30.646160 run osmo-hlr_10.42.42.2(pid=25260): stderr: | 20221213131627314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131627314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131627314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131627314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131627314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131627314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131627326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131627335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131627335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131627335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:30.699404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25249): Terminating (SIGTERM) 13:16:30.741966 run iperf3-srv_10.42.42.10(pid=25250): Terminating (SIGTERM) 13:16:30.784711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25251): Terminating (SIGTERM) 13:16:30.830798 run iperf3-srv_10.42.42.10(pid=25252): Terminating (SIGTERM) 13:16:30.878074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25253): Terminating (SIGTERM) 13:16:30.921218 run iperf3-srv_10.42.42.10(pid=25254): Terminating (SIGTERM) 13:16:30.966170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25255): Terminating (SIGTERM) 13:16:31.008180 run iperf3-srv_10.42.42.10(pid=25256): Terminating (SIGTERM) 13:16:31.052775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25259): Terminating (SIGTERM) 13:16:31.096160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25262): Terminating (SIGTERM) 13:16:31.139810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25266): Terminating (SIGTERM) 13:16:31.183398 --- ParallelTerminationStrategy: PID 25249 died... 13:16:31.203441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25249): Terminated: ok {rc=0} 13:16:31.250544 --- ParallelTerminationStrategy: PID 25250 died... 13:16:31.270128 run iperf3-srv_10.42.42.10(pid=25250): Terminated {rc=256} 13:16:31.317519 --- ParallelTerminationStrategy: PID 25251 died... 13:16:31.336796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25251): Terminated: ok {rc=0} 13:16:31.382542 --- ParallelTerminationStrategy: PID 25252 died... 13:16:31.402032 run iperf3-srv_10.42.42.10(pid=25252): Terminated {rc=256} 13:16:31.446758 --- ParallelTerminationStrategy: PID 25253 died... 13:16:31.466384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25253): Terminated: ok {rc=0} 13:16:31.512532 --- ParallelTerminationStrategy: PID 25254 died... 13:16:31.532473 run iperf3-srv_10.42.42.10(pid=25254): Terminated {rc=256} 13:16:31.577846 --- ParallelTerminationStrategy: PID 25255 died... 13:16:31.597656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25255): Terminated: ok {rc=0} 13:16:31.643008 --- ParallelTerminationStrategy: PID 25256 died... 13:16:31.662883 run iperf3-srv_10.42.42.10(pid=25256): Terminated {rc=256} 13:16:31.708915 --- ParallelTerminationStrategy: PID 25259 died... 13:16:31.728365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25259): Terminated: ok {rc=0} 13:16:31.773489 --- ParallelTerminationStrategy: PID 25262 died... 13:16:31.793400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25262): Terminated: ok {rc=0} 13:16:31.838473 --- ParallelTerminationStrategy: PID 25266 died... 13:16:31.858365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25266): Terminated: ok {rc=0} 13:16:31.946507 bus /gobi_4: Setting Powered False 13:16:33.043619 bus /gobi_4: Setting Powered False 13:16:34.160800 bus /gobi_1: Setting Powered False 13:16:35.260627 bus /gobi_1: Setting Powered False 13:16:36.376258 bus /gobi_0: Setting Powered False 13:16:37.475319 bus /gobi_0: Setting Powered False 13:16:38.589591 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 13:16:39.694529 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:39.706046 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:39.743333 tst ping.py: using LAC 34195 13:16:39.860141 tst ping.py: using RAC 25 13:16:39.977432 tst ping.py: using CellId 34195 13:16:40.095989 tst ping.py: using BVCI 34196 13:16:40.205700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.216463 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.227149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.237827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.248316 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.258886 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.269746 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:40.280403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:40.396302 tst ping.py:19: start network... 13:16:40.595594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:41.056051 run create_hlr_db(pid=25268): Launched 13:16:41.178089 bus /gobi_6: Setting Powered False 13:16:42.237124 run create_hlr_db(pid=25268): Terminated: ok {rc=0} 13:16:42.675962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25270): Launched 13:16:42.999092 run osmo-hlr_10.42.42.2(pid=25271): Launched 13:16:43.122585 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:43.678657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25273): Launched 13:16:44.000889 run osmo-stp_10.42.42.5(pid=25274): Launched 13:16:44.124313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:44.676628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25276): Launched 13:16:44.799330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:45.070199 run patchelf(pid=25277): Launched 13:16:45.250328 run osmo-stp_10.42.42.5(pid=25274): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25274)] 13:16:45.386657 run osmo-stp_10.42.42.5(pid=25274): stdout: | (launched: 2022-12-13_13:16:43.941909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:45.524276 run osmo-stp_10.42.42.5(pid=25274): stderr: | 20221213131644134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131644134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131644134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131644135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131644135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131644135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131644135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:45.663068 run osmo-stp_10.42.42.5(pid=25274): stdout: | (launched: 2022-12-13_13:16:43.941909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:45.794173 run osmo-stp_10.42.42.5(pid=25274): stderr: | 20221213131644134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131644134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131644134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131644135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131644135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131644135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131644135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:45.990315 run patchelf(pid=25277): Terminating (SIGINT) 13:16:46.176600 run patchelf(pid=25277): Terminated: ok {rc=0} 13:16:46.310171 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25274): Process ended prematurely: osmo-stp_10.42.42.5(pid=25274) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25274)] [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 13:16:46.321108 tst ping.py:22: Test FAILED (6.6 sec) 13:16:46.350605 run osmo-hlr_10.42.42.2(pid=25271): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25271)] 13:16:46.405464 run osmo-hlr_10.42.42.2(pid=25271): stdout: | (launched: 2022-12-13_13:16:42.940216) 13:16:46.459650 run osmo-hlr_10.42.42.2(pid=25271): stderr: | 20221213131643137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131643137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131643137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131643137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131643137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131643137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131643149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131643158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131643158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131643158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:46.514763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25270): Terminating (SIGTERM) 13:16:46.558985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25273): Terminating (SIGTERM) 13:16:46.605044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25276): Terminating (SIGTERM) 13:16:46.650233 --- ParallelTerminationStrategy: PID 25270 died... 13:16:46.672351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25270): Terminated: ok {rc=0} 13:16:46.721632 --- ParallelTerminationStrategy: PID 25273 died... 13:16:46.743261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25273): Terminated: ok {rc=0} 13:16:46.792410 --- ParallelTerminationStrategy: PID 25276 died... 13:16:46.814028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25276): Terminated: ok {rc=0} 13:16:46.907195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:16:47.999320 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.010758 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:48.051704 tst ping_idle_ping.py: using LAC 34196 13:16:48.169133 tst ping_idle_ping.py: using RAC 26 13:16:48.284716 tst ping_idle_ping.py: using CellId 34196 13:16:48.401156 tst ping_idle_ping.py: using BVCI 34197 13:16:48.510283 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.521276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.532258 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.543138 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.554146 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.565094 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.576110 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:48.587232 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:48.706955 tst ping_idle_ping.py:24: start network... 13:16:48.922830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:49.422159 run create_hlr_db(pid=25278): Launched 13:16:49.546908 bus /gobi_6: Setting Powered False 13:16:50.610496 run create_hlr_db(pid=25278): Terminated: ok {rc=0} 13:16:51.059255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25280): Launched 13:16:51.382113 run osmo-hlr_10.42.42.2(pid=25281): Launched 13:16:51.505459 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:52.055407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25283): Launched 13:16:52.355900 run osmo-stp_10.42.42.5(pid=25284): Launched 13:16:52.469618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:52.985935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25286): Launched 13:16:53.100436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:53.353602 run patchelf(pid=25287): Launched 13:16:53.522949 run osmo-stp_10.42.42.5(pid=25284): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25284)] 13:16:53.651379 run osmo-stp_10.42.42.5(pid=25284): stdout: | (launched: 2022-12-13_13:16:52.300056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:53.781483 run osmo-stp_10.42.42.5(pid=25284): stderr: | 20221213131652469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131652469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131652470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131652470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131652471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131652471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131652471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:53.911993 run osmo-stp_10.42.42.5(pid=25284): stdout: | (launched: 2022-12-13_13:16:52.300056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:54.035809 run osmo-stp_10.42.42.5(pid=25284): stderr: | 20221213131652469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131652469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131652470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131652470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131652471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131652471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131652471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:54.182792 run patchelf(pid=25287): Terminating (SIGINT) 13:16:54.352861 run patchelf(pid=25287): Terminated: ok {rc=0} 13:16:54.475389 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25284): Process ended prematurely: osmo-stp_10.42.42.5(pid=25284) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25284)] [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 13:16:54.484848 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:16:54.511653 run osmo-hlr_10.42.42.2(pid=25281): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25281)] 13:16:54.560285 run osmo-hlr_10.42.42.2(pid=25281): stdout: | (launched: 2022-12-13_13:16:51.322702) 13:16:54.609892 run osmo-hlr_10.42.42.2(pid=25281): stderr: | 20221213131651519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131651519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131651519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131651519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131651520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131651520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131651532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131651541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131651541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131651541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:54.659860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25280): Terminating (SIGTERM) 13:16:54.699989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25283): Terminating (SIGTERM) 13:16:54.740028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25286): Terminating (SIGTERM) 13:16:54.780375 --- ParallelTerminationStrategy: PID 25280 died... 13:16:54.799819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25280): Terminated: ok {rc=0} 13:16:54.844482 --- ParallelTerminationStrategy: PID 25283 died... 13:16:54.863556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25283): Terminated: ok {rc=0} 13:16:54.907989 --- ParallelTerminationStrategy: PID 25286 died... 13:16:54.927004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25286): Terminated: ok {rc=0} 13:16:55.013053 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:16:56.310085 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:56.316653 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:16:56.337634 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:16:56.376833 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:16:56.462319 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:16:56.482907 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:16:56.521168 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:16:57.116630 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:16:57.166385 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.177370 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:16:57.232296 tst cs_paging_gprs_active.py: using LAC 34197 13:16:57.352240 tst cs_paging_gprs_active.py: using RAC 27 13:16:57.472401 tst cs_paging_gprs_active.py: using CellId 34197 13:16:57.591781 tst cs_paging_gprs_active.py: using BVCI 34198 13:16:57.703596 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.714544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.725209 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.735770 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.746429 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.757002 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.768174 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.778887 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:16:57.789787 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:16:57.910743 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:16:58.028765 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:16:58.234693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:58.543312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25291): Launched 13:16:58.811222 run iperf3-srv_10.42.42.10(pid=25292): Launched 13:16:58.927883 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:16:59.132773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:59.440899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25293): Launched 13:16:59.710099 run iperf3-srv_10.42.42.10(pid=25294): Launched 13:16:59.825251 tst cs_paging_gprs_active.py:38: start network... 13:17:00.030510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:00.506450 run create_hlr_db(pid=25295): Launched 13:17:00.631728 bus /gobi_6: Setting Powered False 13:17:01.711968 run create_hlr_db(pid=25295): Terminated: ok {rc=0} 13:17:02.184651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25300): Launched 13:17:02.525976 run osmo-hlr_10.42.42.2(pid=25301): Launched 13:17:02.653528 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:03.219430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25303): Launched 13:17:03.548299 run osmo-stp_10.42.42.5(pid=25304): Launched 13:17:03.676143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:04.240196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25306): Launched 13:17:04.365903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:04.642912 run patchelf(pid=25307): Launched 13:17:04.826299 run osmo-stp_10.42.42.5(pid=25304): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25304)] 13:17:04.964444 run osmo-stp_10.42.42.5(pid=25304): stdout: | (launched: 2022-12-13_13:17:03.487753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:05.104203 run osmo-stp_10.42.42.5(pid=25304): stderr: | 20221213131703681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131703681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131703681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131703682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131703682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131703682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131703682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:05.244341 run osmo-stp_10.42.42.5(pid=25304): stdout: | (launched: 2022-12-13_13:17:03.487753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:05.378311 run osmo-stp_10.42.42.5(pid=25304): stderr: | 20221213131703681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131703681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131703681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131703682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131703682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131703682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131703682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:05.538030 run patchelf(pid=25307): Terminating (SIGINT) 13:17:05.722269 run patchelf(pid=25307): Terminated: ok {rc=0} 13:17:05.855124 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25304): Process ended prematurely: osmo-stp_10.42.42.5(pid=25304) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25304)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:17:05.865405 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:17:05.893897 run osmo-hlr_10.42.42.2(pid=25301): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25301)] 13:17:05.945446 run osmo-hlr_10.42.42.2(pid=25301): stdout: | (launched: 2022-12-13_13:17:02.465729) 13:17:05.997704 run osmo-hlr_10.42.42.2(pid=25301): stderr: | 20221213131702662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131702662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131702662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131702662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131702663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131702663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131702675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131702684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131702684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131702684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:06.050609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25291): Terminating (SIGTERM) 13:17:06.092728 run iperf3-srv_10.42.42.10(pid=25292): Terminating (SIGTERM) 13:17:06.135251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25293): Terminating (SIGTERM) 13:17:06.177925 run iperf3-srv_10.42.42.10(pid=25294): Terminating (SIGTERM) 13:17:06.220327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25300): Terminating (SIGTERM) 13:17:06.263123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25303): Terminating (SIGTERM) 13:17:06.305562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25306): Terminating (SIGTERM) 13:17:06.348451 --- ParallelTerminationStrategy: PID 25291 died... 13:17:06.369130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25291): Terminated: ok {rc=0} 13:17:06.415872 --- ParallelTerminationStrategy: PID 25292 died... 13:17:06.435962 run iperf3-srv_10.42.42.10(pid=25292): Terminated {rc=256} 13:17:06.482348 --- ParallelTerminationStrategy: PID 25293 died... 13:17:06.502396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25293): Terminated: ok {rc=0} 13:17:06.549359 --- ParallelTerminationStrategy: PID 25294 died... 13:17:06.569285 run iperf3-srv_10.42.42.10(pid=25294): Terminated {rc=256} 13:17:06.615887 --- ParallelTerminationStrategy: PID 25300 died... 13:17:06.636076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25300): Terminated: ok {rc=0} 13:17:06.682605 --- ParallelTerminationStrategy: PID 25303 died... 13:17:06.702640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25303): Terminated: ok {rc=0} 13:17:06.748754 --- ParallelTerminationStrategy: PID 25306 died... 13:17:06.768801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25306): Terminated: ok {rc=0} 13:17:06.857565 bus /gobi_0: Setting Powered False 13:17:07.954495 bus /gobi_0: Setting Powered False 13:17:09.067028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:17:10.216717 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.228716 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:10.293064 tst iperf3.py: using LAC 34198 13:17:10.423207 tst iperf3.py: using RAC 28 13:17:10.551182 tst iperf3.py: using CellId 34198 13:17:10.679425 tst iperf3.py: using BVCI 34199 13:17:10.793078 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.804119 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.814924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.825779 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.836636 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.847699 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.858677 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.869463 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:10.880324 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:11.001117 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:11.221421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:11.549583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25308): Launched 13:17:11.835212 run iperf3-srv_10.42.42.10(pid=25309): Launched 13:17:11.959439 tst iperf3.py:8: start network... 13:17:12.179050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:12.684768 run create_hlr_db(pid=25310): Launched 13:17:12.809269 bus /gobi_6: Setting Powered False 13:17:13.873059 run create_hlr_db(pid=25310): Terminated: ok {rc=0} 13:17:14.324908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Launched 13:17:14.651547 run osmo-hlr_10.42.42.2(pid=25313): Launched 13:17:14.778270 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:15.343065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Launched 13:17:15.671174 run osmo-stp_10.42.42.5(pid=25316): Launched 13:17:15.797108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:16.501917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Launched 13:17:16.633996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:16.898918 run patchelf(pid=25319): Launched 13:17:17.084824 run osmo-stp_10.42.42.5(pid=25316): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] 13:17:17.216871 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-13_13:17:15.611320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:17.353216 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221213131715804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131715804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131715804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131715805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131715805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131715805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131715805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:17.493652 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-13_13:17:15.611320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:17.628416 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221213131715804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131715804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131715804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131715805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131715805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131715805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131715805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:17.787001 run patchelf(pid=25319): Terminating (SIGINT) 13:17:17.970425 run patchelf(pid=25319): Terminated: ok {rc=0} 13:17:18.102642 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 13:17:18.113322 tst iperf3.py:8: Test FAILED (7.9 sec) 13:17:18.141725 run osmo-hlr_10.42.42.2(pid=25313): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25313)] 13:17:18.192843 run osmo-hlr_10.42.42.2(pid=25313): stdout: | (launched: 2022-12-13_13:17:14.591588) 13:17:18.245354 run osmo-hlr_10.42.42.2(pid=25313): stderr: | 20221213131714788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131714788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131714788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131714788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131714788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131714788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131714804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131714814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131714814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131714814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:18.297969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25308): Terminating (SIGTERM) 13:17:18.340265 run iperf3-srv_10.42.42.10(pid=25309): Terminating (SIGTERM) 13:17:18.382634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminating (SIGTERM) 13:17:18.425190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminating (SIGTERM) 13:17:18.467589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Terminating (SIGTERM) 13:17:18.510788 --- ParallelTerminationStrategy: PID 25308 died... 13:17:18.531326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25308): Terminated: ok {rc=0} 13:17:18.578678 --- ParallelTerminationStrategy: PID 25309 died... 13:17:18.599287 run iperf3-srv_10.42.42.10(pid=25309): Terminated {rc=256} 13:17:18.645924 --- ParallelTerminationStrategy: PID 25312 died... 13:17:18.665999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminated: ok {rc=0} 13:17:18.712627 --- ParallelTerminationStrategy: PID 25315 died... 13:17:18.732618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminated: ok {rc=0} 13:17:18.779368 --- ParallelTerminationStrategy: PID 25318 died... 13:17:18.799467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Terminated: ok {rc=0} 13:17:18.888738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:17:20.039556 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.052347 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:20.110919 tst iperf3m4.py: using LAC 34199 13:17:20.240502 tst iperf3m4.py: using RAC 29 13:17:20.361571 tst iperf3m4.py: using CellId 34199 13:17:20.490329 tst iperf3m4.py: using BVCI 34200 13:17:20.611779 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.623326 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.634650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.645995 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.657980 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.669004 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.680940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.691985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:20.703962 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:20.828572 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:20.948094 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:21.069539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:21.188442 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:21.393410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:21.702155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25320): Launched 13:17:21.968411 run iperf3-srv_10.42.42.10(pid=25321): Launched 13:17:22.083300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:17:22.286666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:22.593486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25322): Launched 13:17:22.861782 run iperf3-srv_10.42.42.10(pid=25323): Launched 13:17:22.977494 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:17:23.182287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:23.490747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25324): Launched 13:17:23.760113 run iperf3-srv_10.42.42.10(pid=25325): Launched 13:17:23.875081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:17:24.078470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:24.384770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25326): Launched 13:17:24.652344 run iperf3-srv_10.42.42.10(pid=25327): Launched 13:17:24.767431 tst iperf3m4.py:8: start network... 13:17:24.970651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:25.444056 run create_hlr_db(pid=25328): Launched 13:17:25.573289 bus /gobi_6: Setting Powered False 13:17:26.637716 run create_hlr_db(pid=25328): Terminated: ok {rc=0} 13:17:27.091727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Launched 13:17:27.421148 run osmo-hlr_10.42.42.2(pid=25331): Launched 13:17:27.547924 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:28.114783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Launched 13:17:28.441915 run osmo-stp_10.42.42.5(pid=25334): Launched 13:17:28.569109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:29.133977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25336): Launched 13:17:29.259529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:29.536454 run patchelf(pid=25337): Launched 13:17:29.720071 run osmo-stp_10.42.42.5(pid=25334): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] 13:17:29.858871 run osmo-stp_10.42.42.5(pid=25334): stdout: | (launched: 2022-12-13_13:17:28.381573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:29.999194 run osmo-stp_10.42.42.5(pid=25334): stderr: | 20221213131728571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131728572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131728572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131728572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131728573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131728573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131728573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:30.139386 run osmo-stp_10.42.42.5(pid=25334): stdout: | (launched: 2022-12-13_13:17:28.381573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:30.273518 run osmo-stp_10.42.42.5(pid=25334): stderr: | 20221213131728571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131728572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131728572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131728572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131728573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131728573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131728573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:30.432613 run patchelf(pid=25337): Terminating (SIGINT) 13:17:30.616712 run patchelf(pid=25337): Terminated: ok {rc=0} 13:17:30.748580 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25334): Process ended prematurely: osmo-stp_10.42.42.5(pid=25334) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:17:30.758937 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:17:30.787980 run osmo-hlr_10.42.42.2(pid=25331): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25331)] 13:17:30.844721 run osmo-hlr_10.42.42.2(pid=25331): stdout: | (launched: 2022-12-13_13:17:27.360682) 13:17:30.897048 run osmo-hlr_10.42.42.2(pid=25331): stderr: | 20221213131727558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131727558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131727558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131727558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131727558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131727558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131727571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131727579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131727579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131727580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:30.949754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25320): Terminating (SIGTERM) 13:17:30.992265 run iperf3-srv_10.42.42.10(pid=25321): Terminating (SIGTERM) 13:17:31.033491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25322): Terminating (SIGTERM) 13:17:31.082169 run iperf3-srv_10.42.42.10(pid=25323): Terminating (SIGTERM) 13:17:31.128686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25324): Terminating (SIGTERM) 13:17:31.171490 run iperf3-srv_10.42.42.10(pid=25325): Terminating (SIGTERM) 13:17:31.214325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25326): Terminating (SIGTERM) 13:17:31.256609 run iperf3-srv_10.42.42.10(pid=25327): Terminating (SIGTERM) 13:17:31.311609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Terminating (SIGTERM) 13:17:31.366655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Terminating (SIGTERM) 13:17:31.422962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25336): Terminating (SIGTERM) 13:17:31.477591 --- ParallelTerminationStrategy: PID 25320 died... 13:17:31.503917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25320): Terminated: ok {rc=0} 13:17:31.563871 --- ParallelTerminationStrategy: PID 25321 died... 13:17:31.590412 run iperf3-srv_10.42.42.10(pid=25321): Terminated {rc=256} 13:17:31.653212 --- ParallelTerminationStrategy: PID 25322 died... 13:17:31.679936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25322): Terminated: ok {rc=0} 13:17:31.739380 --- ParallelTerminationStrategy: PID 25323 died... 13:17:31.765358 run iperf3-srv_10.42.42.10(pid=25323): Terminated {rc=256} 13:17:31.828102 --- ParallelTerminationStrategy: PID 25324 died... 13:17:31.854567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25324): Terminated: ok {rc=0} 13:17:31.913998 --- ParallelTerminationStrategy: PID 25325 died... 13:17:31.939524 run iperf3-srv_10.42.42.10(pid=25325): Terminated {rc=256} 13:17:32.002072 --- ParallelTerminationStrategy: PID 25326 died... 13:17:32.028505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25326): Terminated: ok {rc=0} 13:17:32.089970 --- ParallelTerminationStrategy: PID 25327 died... 13:17:32.114290 run iperf3-srv_10.42.42.10(pid=25327): Terminated {rc=256} 13:17:32.176822 --- ParallelTerminationStrategy: PID 25330 died... 13:17:32.203048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Terminated: ok {rc=0} 13:17:32.262372 --- ParallelTerminationStrategy: PID 25333 died... 13:17:32.282818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Terminated: ok {rc=0} 13:17:32.332341 --- ParallelTerminationStrategy: PID 25336 died... 13:17:32.352652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25336): Terminated: ok {rc=0} 13:17:32.443674 bus /gobi_4: Setting Powered False 13:17:33.543173 bus /gobi_4: Setting Powered False 13:17:34.659703 bus /gobi_1: Setting Powered False 13:17:35.759478 bus /gobi_1: Setting Powered False 13:17:36.875833 bus /gobi_0: Setting Powered False 13:17:37.975418 bus /gobi_0: Setting Powered False 13:17:39.095273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:17:40.200409 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.212467 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:40.270976 tst ping.py: using LAC 34200 13:17:40.400646 tst ping.py: using RAC 30 13:17:40.524086 tst ping.py: using CellId 34200 13:17:40.653689 tst ping.py: using BVCI 34201 13:17:40.771830 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.783234 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.794404 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.805596 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.817026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.828365 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.839982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:40.851386 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:40.971312 tst ping.py:19: start network... 13:17:41.187642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:41.685128 run create_hlr_db(pid=25341): Launched 13:17:41.808548 bus /gobi_6: Setting Powered False 13:17:42.872404 run create_hlr_db(pid=25341): Terminated: ok {rc=0} 13:17:43.302860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25343): Launched 13:17:43.602897 run osmo-hlr_10.42.42.2(pid=25344): Launched 13:17:43.716383 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:44.238806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25346): Launched 13:17:44.537915 run osmo-stp_10.42.42.5(pid=25347): Launched 13:17:44.650775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:45.167830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25349): Launched 13:17:45.281827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:45.534821 run patchelf(pid=25350): Launched 13:17:45.701430 run osmo-stp_10.42.42.5(pid=25347): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25347)] 13:17:45.838129 run osmo-stp_10.42.42.5(pid=25347): stdout: | (launched: 2022-12-13_13:17:44.482000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:46.000659 run osmo-stp_10.42.42.5(pid=25347): stderr: | 20221213131744650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131744650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131744651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131744651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131744652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131744652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131744652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:46.131797 run osmo-stp_10.42.42.5(pid=25347): stdout: | (launched: 2022-12-13_13:17:44.482000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:46.256524 run osmo-stp_10.42.42.5(pid=25347): stderr: | 20221213131744650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131744650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131744651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131744651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131744652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131744652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131744652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:46.404465 run patchelf(pid=25350): Terminating (SIGINT) 13:17:46.578096 run patchelf(pid=25350): Terminated: ok {rc=0} 13:17:46.702513 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25347): Process ended prematurely: osmo-stp_10.42.42.5(pid=25347) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25347)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 13:17:46.712285 tst ping.py:22: Test FAILED (6.5 sec) 13:17:46.740054 run osmo-hlr_10.42.42.2(pid=25344): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25344)] 13:17:46.788871 run osmo-hlr_10.42.42.2(pid=25344): stdout: | (launched: 2022-12-13_13:17:43.546626) 13:17:46.839164 run osmo-hlr_10.42.42.2(pid=25344): stderr: | 20221213131743722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131743722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131743722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131743722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131743722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131743722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131743734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131743743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131743743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131743744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:46.890030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25343): Terminating (SIGTERM) 13:17:46.932030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25346): Terminating (SIGTERM) 13:17:46.975535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25349): Terminating (SIGTERM) 13:17:47.018850 --- ParallelTerminationStrategy: PID 25343 died... 13:17:47.038388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25343): Terminated: ok {rc=0} 13:17:47.083726 --- ParallelTerminationStrategy: PID 25346 died... 13:17:47.103186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25346): Terminated: ok {rc=0} 13:17:47.148048 --- ParallelTerminationStrategy: PID 25349 died... 13:17:47.167331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25349): Terminated: ok {rc=0} 13:17:47.252769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:17:48.340437 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.353096 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:48.413321 tst ping_idle_ping.py: using LAC 34201 13:17:48.544373 tst ping_idle_ping.py: using RAC 31 13:17:48.670330 tst ping_idle_ping.py: using CellId 34201 13:17:48.794716 tst ping_idle_ping.py: using BVCI 34202 13:17:48.911760 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.923266 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.934441 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.945609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.956802 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.968310 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.980100 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:48.991545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:49.109573 tst ping_idle_ping.py:24: start network... 13:17:49.310830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:49.779963 run create_hlr_db(pid=25351): Launched 13:17:49.904101 bus /gobi_6: Setting Powered False 13:17:50.963640 run create_hlr_db(pid=25351): Terminated: ok {rc=0} 13:17:51.404300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Launched 13:17:51.727441 run osmo-hlr_10.42.42.2(pid=25354): Launched 13:17:51.849847 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:52.403774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Launched 13:17:52.727787 run osmo-stp_10.42.42.5(pid=25357): Launched 13:17:52.851399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:53.407500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25359): Launched 13:17:53.531846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:53.805435 run patchelf(pid=25360): Launched 13:17:53.986992 run osmo-stp_10.42.42.5(pid=25357): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] 13:17:54.123881 run osmo-stp_10.42.42.5(pid=25357): stdout: | (launched: 2022-12-13_13:17:52.668366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:54.262390 run osmo-stp_10.42.42.5(pid=25357): stderr: | 20221213131752858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131752858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131752858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131752859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131752859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131752859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131752860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:54.400707 run osmo-stp_10.42.42.5(pid=25357): stdout: | (launched: 2022-12-13_13:17:52.668366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:54.532777 run osmo-stp_10.42.42.5(pid=25357): stderr: | 20221213131752858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131752858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131752858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131752859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131752859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131752859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131752860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:54.689985 run patchelf(pid=25360): Terminating (SIGINT) 13:17:54.871135 run patchelf(pid=25360): Terminated: ok {rc=0} 13:17:55.001315 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25357): Process ended prematurely: osmo-stp_10.42.42.5(pid=25357) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:17:55.011046 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:17:55.039269 run osmo-hlr_10.42.42.2(pid=25354): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25354)] 13:17:55.090449 run osmo-hlr_10.42.42.2(pid=25354): stdout: | (launched: 2022-12-13_13:17:51.668081) 13:17:55.143749 run osmo-hlr_10.42.42.2(pid=25354): stderr: | 20221213131751865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131751865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131751865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131751865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131751865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131751865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131751878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131751888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131751889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131751889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:55.196813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Terminating (SIGTERM) 13:17:55.239458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Terminating (SIGTERM) 13:17:55.282801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25359): Terminating (SIGTERM) 13:17:55.326072 --- ParallelTerminationStrategy: PID 25353 died... 13:17:55.346920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25353): Terminated: ok {rc=0} 13:17:55.394370 --- ParallelTerminationStrategy: PID 25356 died... 13:17:55.414845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25356): Terminated: ok {rc=0} 13:17:55.461973 --- ParallelTerminationStrategy: PID 25359 died... 13:17:55.482417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25359): Terminated: ok {rc=0} 13:17:55.572463 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:17:56.864517 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:56.870971 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:17:56.891713 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:17:56.930302 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:17:57.016693 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:17:57.037092 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:17:57.074928 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:17:57.668564 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:17:57.717409 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:57.728049 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:17:57.784620 tst cs_paging_gprs_active.py: using LAC 34202 13:17:57.904748 tst cs_paging_gprs_active.py: using RAC 32 13:17:58.025107 tst cs_paging_gprs_active.py: using CellId 34202 13:17:58.145670 tst cs_paging_gprs_active.py: using BVCI 34203 13:17:58.267503 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.279126 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.290501 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.301867 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.313694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.325411 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.337106 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.348565 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:17:58.360253 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:17:58.478768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:17:58.595700 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:17:58.818603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:59.148766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Launched 13:17:59.434936 run iperf3-srv_10.42.42.10(pid=25365): Launched 13:17:59.558097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:17:59.779144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:00.109424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25366): Launched 13:18:00.396724 run iperf3-srv_10.42.42.10(pid=25367): Launched 13:18:00.519855 tst cs_paging_gprs_active.py:38: start network... 13:18:00.741079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:01.264685 run create_hlr_db(pid=25368): Launched 13:18:01.425371 bus /gobi_6: Setting Powered False 13:18:02.489225 run create_hlr_db(pid=25368): Terminated: ok {rc=0} 13:18:02.928802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25370): Launched 13:18:03.236018 run osmo-hlr_10.42.42.2(pid=25371): Launched 13:18:03.352238 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:03.893210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25373): Launched 13:18:04.199238 run osmo-stp_10.42.42.5(pid=25374): Launched 13:18:04.314385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:04.841396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25376): Launched 13:18:04.959173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:05.219757 run patchelf(pid=25377): Launched 13:18:05.390126 run osmo-stp_10.42.42.5(pid=25374): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25374)] 13:18:05.519470 run osmo-stp_10.42.42.5(pid=25374): stdout: | (launched: 2022-12-13_13:18:04.142672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:05.651207 run osmo-stp_10.42.42.5(pid=25374): stderr: | 20221213131804312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131804312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131804313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131804314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131804314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131804314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131804314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:05.782825 run osmo-stp_10.42.42.5(pid=25374): stdout: | (launched: 2022-12-13_13:18:04.142672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:05.907541 run osmo-stp_10.42.42.5(pid=25374): stderr: | 20221213131804312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131804312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131804313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131804314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131804314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131804314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131804314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:06.056061 run patchelf(pid=25377): Terminating (SIGINT) 13:18:06.227495 run patchelf(pid=25377): Terminated: ok {rc=0} 13:18:06.351035 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25374): Process ended prematurely: osmo-stp_10.42.42.5(pid=25374) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25374)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:18:06.360520 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:18:06.387302 run osmo-hlr_10.42.42.2(pid=25371): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25371)] 13:18:06.434588 run osmo-hlr_10.42.42.2(pid=25371): stdout: | (launched: 2022-12-13_13:18:03.179551) 13:18:06.483517 run osmo-hlr_10.42.42.2(pid=25371): stderr: | 20221213131803356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131803356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131803356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131803356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131803357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131803357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131803369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131803378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131803379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131803379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:06.532858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Terminating (SIGTERM) 13:18:06.572554 run iperf3-srv_10.42.42.10(pid=25365): Terminating (SIGTERM) 13:18:06.612093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25366): Terminating (SIGTERM) 13:18:06.651683 run iperf3-srv_10.42.42.10(pid=25367): Terminating (SIGTERM) 13:18:06.691196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25370): Terminating (SIGTERM) 13:18:06.730711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25373): Terminating (SIGTERM) 13:18:06.770339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25376): Terminating (SIGTERM) 13:18:06.810113 --- ParallelTerminationStrategy: PID 25364 died... 13:18:06.829201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Terminated: ok {rc=0} 13:18:06.872801 --- ParallelTerminationStrategy: PID 25365 died... 13:18:06.891452 run iperf3-srv_10.42.42.10(pid=25365): Terminated {rc=256} 13:18:06.934849 --- ParallelTerminationStrategy: PID 25366 died... 13:18:06.953163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25366): Terminated: ok {rc=0} 13:18:06.996447 --- ParallelTerminationStrategy: PID 25367 died... 13:18:07.014768 run iperf3-srv_10.42.42.10(pid=25367): Terminated {rc=256} 13:18:07.058133 --- ParallelTerminationStrategy: PID 25370 died... 13:18:07.076363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25370): Terminated: ok {rc=0} 13:18:07.119904 --- ParallelTerminationStrategy: PID 25373 died... 13:18:07.138273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25373): Terminated: ok {rc=0} 13:18:07.181742 --- ParallelTerminationStrategy: PID 25376 died... 13:18:07.200304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25376): Terminated: ok {rc=0} 13:18:07.284010 bus /gobi_0: Setting Powered False 13:18:08.381686 bus /gobi_0: Setting Powered False 13:18:09.498228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:18:10.649186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:10.661270 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:10.722124 tst iperf3.py: using LAC 34203 13:18:10.851841 tst iperf3.py: using RAC 33 13:18:10.979119 tst iperf3.py: using CellId 34203 13:18:11.108820 tst iperf3.py: using BVCI 34204 13:18:11.229259 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.240639 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.251772 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.262868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.274328 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.285744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.297252 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.308520 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:11.320107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:11.440884 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:11.662416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:11.989871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Launched 13:18:12.274906 run iperf3-srv_10.42.42.10(pid=25379): Launched 13:18:12.397906 tst iperf3.py:8: start network... 13:18:12.618124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:13.125192 run create_hlr_db(pid=25380): Launched 13:18:13.250178 bus /gobi_6: Setting Powered False 13:18:14.314868 run create_hlr_db(pid=25380): Terminated: ok {rc=0} 13:18:14.751387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Launched 13:18:15.057938 run osmo-hlr_10.42.42.2(pid=25383): Launched 13:18:15.173521 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:15.699483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Launched 13:18:16.038757 run osmo-stp_10.42.42.5(pid=25386): Launched 13:18:16.239185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:16.862289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25388): Launched 13:18:17.003115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:17.291171 run patchelf(pid=25389): Launched 13:18:17.473173 run osmo-stp_10.42.42.5(pid=25386): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] 13:18:17.612649 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-13_13:18:15.975170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:17.753295 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221213131816287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131816287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131816288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131816288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131816288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131816289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131816289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:17.893765 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-13_13:18:15.975170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:18.027889 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221213131816287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131816287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131816288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131816288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131816288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131816289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131816289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:18.187383 run patchelf(pid=25389): Terminating (SIGINT) 13:18:18.371391 run patchelf(pid=25389): Terminated: ok {rc=0} 13:18:18.503594 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25386): Process ended prematurely: osmo-stp_10.42.42.5(pid=25386) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 13:18:18.514047 tst iperf3.py:8: Test FAILED (7.9 sec) 13:18:18.542387 run osmo-hlr_10.42.42.2(pid=25383): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25383)] 13:18:18.593508 run osmo-hlr_10.42.42.2(pid=25383): stdout: | (launched: 2022-12-13_13:18:15.000900) 13:18:18.645902 run osmo-hlr_10.42.42.2(pid=25383): stderr: | 20221213131815178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131815178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131815178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131815178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131815178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131815179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131815194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131815205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131815205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131815205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:18.698843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Terminating (SIGTERM) 13:18:18.740941 run iperf3-srv_10.42.42.10(pid=25379): Terminating (SIGTERM) 13:18:18.783860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Terminating (SIGTERM) 13:18:18.826274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Terminating (SIGTERM) 13:18:18.868663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25388): Terminating (SIGTERM) 13:18:18.912174 --- ParallelTerminationStrategy: PID 25378 died... 13:18:18.932831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Terminated: ok {rc=0} 13:18:18.980002 --- ParallelTerminationStrategy: PID 25379 died... 13:18:19.000201 run iperf3-srv_10.42.42.10(pid=25379): Terminated {rc=256} 13:18:19.046728 --- ParallelTerminationStrategy: PID 25382 died... 13:18:19.066527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Terminated: ok {rc=0} 13:18:19.113164 --- ParallelTerminationStrategy: PID 25385 died... 13:18:19.133063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Terminated: ok {rc=0} 13:18:19.179668 --- ParallelTerminationStrategy: PID 25388 died... 13:18:19.199804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25388): Terminated: ok {rc=0} 13:18:19.289266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:18:20.437306 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:20.448669 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:20.505646 tst iperf3m4.py: using LAC 34204 13:18:20.629754 tst iperf3m4.py: using RAC 34 13:18:20.749166 tst iperf3m4.py: using CellId 34204 13:18:20.867106 tst iperf3m4.py: using BVCI 34205 13:18:20.979514 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:20.990510 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.001231 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.011833 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.022398 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.033015 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.043819 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.054463 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:21.065208 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:21.181156 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:21.299978 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:21.421373 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:21.538050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:21.741102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:22.045415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25390): Launched 13:18:22.312493 run iperf3-srv_10.42.42.10(pid=25391): Launched 13:18:22.426707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:18:22.629242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:22.933678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25392): Launched 13:18:23.201324 run iperf3-srv_10.42.42.10(pid=25393): Launched 13:18:23.317438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:18:23.519641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:23.824791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25394): Launched 13:18:24.090556 run iperf3-srv_10.42.42.10(pid=25395): Launched 13:18:24.207731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:18:24.411091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:24.717455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Launched 13:18:24.984834 run iperf3-srv_10.42.42.10(pid=25397): Launched 13:18:25.099401 tst iperf3m4.py:8: start network... 13:18:25.302656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:25.773965 run create_hlr_db(pid=25398): Launched 13:18:25.901502 bus /gobi_6: Setting Powered False 13:18:26.960299 run create_hlr_db(pid=25398): Terminated: ok {rc=0} 13:18:27.406210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Launched 13:18:27.736330 run osmo-hlr_10.42.42.2(pid=25401): Launched 13:18:27.862587 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:28.431115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Launched 13:18:28.759936 run osmo-stp_10.42.42.5(pid=25404): Launched 13:18:28.884794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:29.450192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Launched 13:18:29.578208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:29.855846 run patchelf(pid=25407): Launched 13:18:30.039240 run osmo-stp_10.42.42.5(pid=25404): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] 13:18:30.178776 run osmo-stp_10.42.42.5(pid=25404): stdout: | (launched: 2022-12-13_13:18:28.699212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:30.319788 run osmo-stp_10.42.42.5(pid=25404): stderr: | 20221213131828888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131828888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131828888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131828889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131828889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131828889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131828889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:30.460178 run osmo-stp_10.42.42.5(pid=25404): stdout: | (launched: 2022-12-13_13:18:28.699212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:30.595519 run osmo-stp_10.42.42.5(pid=25404): stderr: | 20221213131828888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131828888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131828888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131828889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131828889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131828889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131828889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:30.755164 run patchelf(pid=25407): Terminating (SIGINT) 13:18:30.955530 run patchelf(pid=25407): Terminated: ok {rc=0} 13:18:31.091947 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25404): Process ended prematurely: osmo-stp_10.42.42.5(pid=25404) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:18:31.103426 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:18:31.133656 run osmo-hlr_10.42.42.2(pid=25401): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25401)] 13:18:31.188888 run osmo-hlr_10.42.42.2(pid=25401): stdout: | (launched: 2022-12-13_13:18:27.675870) 13:18:31.243872 run osmo-hlr_10.42.42.2(pid=25401): stderr: | 20221213131827871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131827872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131827872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131827872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131827872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131827872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131827885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131827894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131827894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131827894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:31.299894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25390): Terminating (SIGTERM) 13:18:31.344344 run iperf3-srv_10.42.42.10(pid=25391): Terminating (SIGTERM) 13:18:31.392036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25392): Terminating (SIGTERM) 13:18:31.437868 run iperf3-srv_10.42.42.10(pid=25393): Terminating (SIGTERM) 13:18:31.485685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25394): Terminating (SIGTERM) 13:18:31.531497 run iperf3-srv_10.42.42.10(pid=25395): Terminating (SIGTERM) 13:18:31.580052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Terminating (SIGTERM) 13:18:31.624310 run iperf3-srv_10.42.42.10(pid=25397): Terminating (SIGTERM) 13:18:31.666529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Terminating (SIGTERM) 13:18:31.709235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Terminating (SIGTERM) 13:18:31.752396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Terminating (SIGTERM) 13:18:31.794560 --- ParallelTerminationStrategy: PID 25390 died... 13:18:31.814315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25390): Terminated: ok {rc=0} 13:18:31.861654 --- ParallelTerminationStrategy: PID 25391 died... 13:18:31.882617 run iperf3-srv_10.42.42.10(pid=25391): Terminated {rc=256} 13:18:31.928423 --- ParallelTerminationStrategy: PID 25392 died... 13:18:31.948536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25392): Terminated: ok {rc=0} 13:18:31.994441 --- ParallelTerminationStrategy: PID 25393 died... 13:18:32.013847 run iperf3-srv_10.42.42.10(pid=25393): Terminated {rc=256} 13:18:32.059086 --- ParallelTerminationStrategy: PID 25394 died... 13:18:32.079731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25394): Terminated: ok {rc=0} 13:18:32.124739 --- ParallelTerminationStrategy: PID 25395 died... 13:18:32.143935 run iperf3-srv_10.42.42.10(pid=25395): Terminated {rc=256} 13:18:32.189502 --- ParallelTerminationStrategy: PID 25396 died... 13:18:32.208884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Terminated: ok {rc=0} 13:18:32.253579 --- ParallelTerminationStrategy: PID 25397 died... 13:18:32.273261 run iperf3-srv_10.42.42.10(pid=25397): Terminated {rc=256} 13:18:32.318555 --- ParallelTerminationStrategy: PID 25400 died... 13:18:32.337611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25400): Terminated: ok {rc=0} 13:18:32.381514 --- ParallelTerminationStrategy: PID 25403 died... 13:18:32.400180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25403): Terminated: ok {rc=0} 13:18:32.443956 --- ParallelTerminationStrategy: PID 25406 died... 13:18:32.462835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25406): Terminated: ok {rc=0} 13:18:32.547968 bus /gobi_4: Setting Powered False 13:18:33.648287 bus /gobi_4: Setting Powered False 13:18:34.767931 bus /gobi_1: Setting Powered False 13:18:35.868337 bus /gobi_1: Setting Powered False 13:18:36.986365 bus /gobi_0: Setting Powered False 13:18:38.086078 bus /gobi_0: Setting Powered False 13:18:39.206518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:18:40.310568 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.322178 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:40.379303 tst ping.py: using LAC 34205 13:18:40.499437 tst ping.py: using RAC 35 13:18:40.619541 tst ping.py: using CellId 34205 13:18:40.738843 tst ping.py: using BVCI 34206 13:18:40.848789 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.859738 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.870510 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.881154 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.891823 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.902454 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.913800 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:40.924554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:41.039900 tst ping.py:19: start network... 13:18:41.240835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:41.705253 run create_hlr_db(pid=25408): Launched 13:18:41.827518 bus /gobi_6: Setting Powered False 13:18:42.887228 run create_hlr_db(pid=25408): Terminated: ok {rc=0} 13:18:43.328621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Launched 13:18:43.652015 run osmo-hlr_10.42.42.2(pid=25411): Launched 13:18:43.775457 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:44.339714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Launched 13:18:44.663750 run osmo-stp_10.42.42.5(pid=25414): Launched 13:18:44.786790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:45.340049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25416): Launched 13:18:45.463227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:45.735181 run patchelf(pid=25417): Launched 13:18:45.941730 run osmo-stp_10.42.42.5(pid=25414): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] 13:18:46.081072 run osmo-stp_10.42.42.5(pid=25414): stdout: | (launched: 2022-12-13_13:18:44.604434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:46.213975 run osmo-stp_10.42.42.5(pid=25414): stderr: | 20221213131844793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131844793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131844794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131844794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131844794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131844794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131844795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:46.350120 run osmo-stp_10.42.42.5(pid=25414): stdout: | (launched: 2022-12-13_13:18:44.604434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:46.478586 run osmo-stp_10.42.42.5(pid=25414): stderr: | 20221213131844793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131844793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131844794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131844794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131844794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131844794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131844795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:46.629484 run patchelf(pid=25417): Terminating (SIGINT) 13:18:46.803763 run patchelf(pid=25417): Terminated: ok {rc=0} 13:18:46.929514 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25414): Process ended prematurely: osmo-stp_10.42.42.5(pid=25414) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 13:18:46.939243 tst ping.py:22: Test FAILED (6.6 sec) 13:18:46.967646 run osmo-hlr_10.42.42.2(pid=25411): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25411)] 13:18:47.016763 run osmo-hlr_10.42.42.2(pid=25411): stdout: | (launched: 2022-12-13_13:18:43.592224) 13:18:47.067708 run osmo-hlr_10.42.42.2(pid=25411): stderr: | 20221213131843789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131843789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131843789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131843789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131843789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131843789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131843802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131843810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131843810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131843810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:47.119619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Terminating (SIGTERM) 13:18:47.161096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Terminating (SIGTERM) 13:18:47.204324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25416): Terminating (SIGTERM) 13:18:47.245971 --- ParallelTerminationStrategy: PID 25410 died... 13:18:47.265354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Terminated: ok {rc=0} 13:18:47.309920 --- ParallelTerminationStrategy: PID 25413 died... 13:18:47.328768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Terminated: ok {rc=0} 13:18:47.373242 --- ParallelTerminationStrategy: PID 25416 died... 13:18:47.391938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25416): Terminated: ok {rc=0} 13:18:47.476882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:18:48.563592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:48.576184 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:48.637991 tst ping_idle_ping.py: using LAC 34206 13:18:48.766316 tst ping_idle_ping.py: using RAC 36 13:18:48.893945 tst ping_idle_ping.py: using CellId 34206 13:18:49.020413 tst ping_idle_ping.py: using BVCI 34207 13:18:49.138164 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.149612 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.160589 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.171946 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.183573 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.194989 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.206620 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:49.218338 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:49.340484 tst ping_idle_ping.py:24: start network... 13:18:49.558707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:50.065240 run create_hlr_db(pid=25418): Launched 13:18:50.189258 bus /gobi_6: Setting Powered False 13:18:51.252648 run create_hlr_db(pid=25418): Terminated: ok {rc=0} 13:18:51.684341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Launched 13:18:51.985988 run osmo-hlr_10.42.42.2(pid=25421): Launched 13:18:52.099515 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:52.616098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Launched 13:18:52.916646 run osmo-stp_10.42.42.5(pid=25424): Launched 13:18:53.033441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:53.549666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25426): Launched 13:18:53.664871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:53.918355 run patchelf(pid=25427): Launched 13:18:54.086769 run osmo-stp_10.42.42.5(pid=25424): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] 13:18:54.213597 run osmo-stp_10.42.42.5(pid=25424): stdout: | (launched: 2022-12-13_13:18:52.860872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:54.342342 run osmo-stp_10.42.42.5(pid=25424): stderr: | 20221213131853028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131853028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131853029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131853029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131853029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131853030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131853030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:54.471880 run osmo-stp_10.42.42.5(pid=25424): stdout: | (launched: 2022-12-13_13:18:52.860872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:54.594584 run osmo-stp_10.42.42.5(pid=25424): stderr: | 20221213131853028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131853028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131853029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131853029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131853029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131853030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131853030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:54.739373 run patchelf(pid=25427): Terminating (SIGINT) 13:18:54.907413 run patchelf(pid=25427): Terminated: ok {rc=0} 13:18:55.028639 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25424): Process ended prematurely: osmo-stp_10.42.42.5(pid=25424) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:18:55.037746 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:18:55.064096 run osmo-hlr_10.42.42.2(pid=25421): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25421)] 13:18:55.111603 run osmo-hlr_10.42.42.2(pid=25421): stdout: | (launched: 2022-12-13_13:18:51.930327) 13:18:55.160927 run osmo-hlr_10.42.42.2(pid=25421): stderr: | 20221213131852104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131852104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131852104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131852104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131852104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131852104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131852116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131852125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131852126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131852126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:55.210893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Terminating (SIGTERM) 13:18:55.250817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Terminating (SIGTERM) 13:18:55.290862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25426): Terminating (SIGTERM) 13:18:55.331291 --- ParallelTerminationStrategy: PID 25420 died... 13:18:55.350605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Terminated: ok {rc=0} 13:18:55.394696 --- ParallelTerminationStrategy: PID 25423 died... 13:18:55.413503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Terminated: ok {rc=0} 13:18:55.457651 --- ParallelTerminationStrategy: PID 25426 died... 13:18:55.476240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25426): Terminated: ok {rc=0} 13:18:55.561887 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:18:56.850137 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:18:56.857339 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:18:56.878166 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:18:56.913145 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:18:56.965591 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:18:56.985891 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:18:57.020313 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:18:57.578207 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:18:57.583753 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:57.594977 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:18:57.651545 tst switch_tch_pdch.py: using LAC 34207 13:18:57.770809 tst switch_tch_pdch.py: using RAC 37 13:18:57.890739 tst switch_tch_pdch.py: using CellId 34207 13:18:58.008838 tst switch_tch_pdch.py: using BVCI 34208 13:18:58.117650 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.128819 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.139769 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.150728 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.161558 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.172413 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.183470 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:18:58.194374 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:18:58.315775 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:18:58.434753 tst switch_tch_pdch.py:51: start network... 13:18:58.634611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:59.100285 run create_hlr_db(pid=25431): Launched 13:18:59.223289 bus /gobi_6: Setting Powered False 13:19:00.283118 run create_hlr_db(pid=25431): Terminated: ok {rc=0} 13:19:00.723308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25433): Launched 13:19:01.054860 run osmo-hlr_10.42.42.2(pid=25434): Launched 13:19:01.300072 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:01.960878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25436): Launched 13:19:02.279135 run osmo-stp_10.42.42.5(pid=25437): Launched 13:19:02.394954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:02.914452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25439): Launched 13:19:03.028677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:03.281933 run patchelf(pid=25440): Launched 13:19:03.448194 run osmo-stp_10.42.42.5(pid=25437): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25437)] 13:19:03.575362 run osmo-stp_10.42.42.5(pid=25437): stdout: | (launched: 2022-12-13_13:19:02.223334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:03.703886 run osmo-stp_10.42.42.5(pid=25437): stderr: | 20221213131902391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131902391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131902392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131902392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131902393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131902393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131902393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:03.832707 run osmo-stp_10.42.42.5(pid=25437): stdout: | (launched: 2022-12-13_13:19:02.223334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:03.955247 run osmo-stp_10.42.42.5(pid=25437): stderr: | 20221213131902391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131902391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131902392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131902392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131902393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131902393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131902393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:04.100754 run patchelf(pid=25440): Terminating (SIGINT) 13:19:04.268914 run patchelf(pid=25440): Terminated: ok {rc=0} 13:19:04.390210 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25437): Process ended prematurely: osmo-stp_10.42.42.5(pid=25437) [trial-2390↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25437)] [trial-2390↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:19:04.399037 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:19:04.425662 run osmo-hlr_10.42.42.2(pid=25434): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25434)] 13:19:04.473549 run osmo-hlr_10.42.42.2(pid=25434): stdout: | (launched: 2022-12-13_13:19:00.993179) 13:19:04.522523 run osmo-hlr_10.42.42.2(pid=25434): stderr: | 20221213131901311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131901311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131901311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131901311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131901311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131901311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131901335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131901348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131901348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131901348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:04.571834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25433): Terminating (SIGTERM) 13:19:04.611342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25436): Terminating (SIGTERM) 13:19:04.650925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25439): Terminating (SIGTERM) 13:19:04.690621 --- ParallelTerminationStrategy: PID 25433 died... 13:19:04.710112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25433): Terminated: ok {rc=0} 13:19:04.753812 --- ParallelTerminationStrategy: PID 25436 died... 13:19:04.772298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25436): Terminated: ok {rc=0} 13:19:04.816150 --- ParallelTerminationStrategy: PID 25439 died... 13:19:04.834788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25439): Terminated: ok {rc=0} 13:19:04.920376 bus /gobi_0: Setting Powered False 13:19:06.019554 bus /gobi_0: Setting Powered False 13:19:07.134141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:19:08.369762 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:08.375438 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:19:08.395771 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:19:08.430272 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:19:08.483054 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:19:08.503960 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:19:08.538051 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:19:09.098947 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:19:09.105545 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.117194 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:19:09.175347 tst switch_tch_pdch.py: using LAC 34208 13:19:09.292719 tst switch_tch_pdch.py: using RAC 38 13:19:09.409348 tst switch_tch_pdch.py: using CellId 34208 13:19:09.526327 tst switch_tch_pdch.py: using BVCI 34209 13:19:09.637450 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.648289 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.658990 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.669644 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.680142 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.690740 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.701615 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:19:09.712166 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:19:09.829829 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:19:09.952585 tst switch_tch_pdch.py:51: start network... 13:19:10.169155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:10.638528 run create_hlr_db(pid=25444): Launched 13:19:10.763342 bus /gobi_6: Setting Powered False 13:19:11.826656 run create_hlr_db(pid=25444): Terminated: ok {rc=0} 13:19:12.231165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Launched 13:19:12.530831 run osmo-hlr_10.42.42.2(pid=25447): Launched 13:19:12.644035 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:13.131790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Launched 13:19:13.430537 run osmo-stp_10.42.42.5(pid=25450): Launched 13:19:13.545552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:14.036759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Launched 13:19:14.151414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:14.403722 run patchelf(pid=25453): Launched 13:19:14.570279 run osmo-stp_10.42.42.5(pid=25450): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] 13:19:14.696890 run osmo-stp_10.42.42.5(pid=25450): stdout: | (launched: 2022-12-13_13:19:13.374870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:14.824831 run osmo-stp_10.42.42.5(pid=25450): stderr: | 20221213131913543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131913543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131913543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131913543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131913544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131913544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131913544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:14.952825 run osmo-stp_10.42.42.5(pid=25450): stdout: | (launched: 2022-12-13_13:19:13.374870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:15.074832 run osmo-stp_10.42.42.5(pid=25450): stderr: | 20221213131913543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131913543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131913543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131913543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131913544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131913544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131913544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:15.219628 run patchelf(pid=25453): Terminating (SIGINT) 13:19:15.387125 run patchelf(pid=25453): Terminated: ok {rc=0} 13:19:15.507742 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25450): Process ended prematurely: osmo-stp_10.42.42.5(pid=25450) [trial-2390↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] [trial-2390↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:19:15.516825 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:19:15.543098 run osmo-hlr_10.42.42.2(pid=25447): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25447)] 13:19:15.590439 run osmo-hlr_10.42.42.2(pid=25447): stdout: | (launched: 2022-12-13_13:19:12.474453) 13:19:15.639299 run osmo-hlr_10.42.42.2(pid=25447): stderr: | 20221213131912648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131912648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131912648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131912648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131912648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131912649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131912660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131912670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131912670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131912670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:15.688790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Terminating (SIGTERM) 13:19:15.729045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Terminating (SIGTERM) 13:19:15.768941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Terminating (SIGTERM) 13:19:15.809041 --- ParallelTerminationStrategy: PID 25446 died... 13:19:15.828187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Terminated: ok {rc=0} 13:19:15.873763 --- ParallelTerminationStrategy: PID 25449 died... 13:19:15.892840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Terminated: ok {rc=0} 13:19:15.942638 --- ParallelTerminationStrategy: PID 25452 died... 13:19:15.962398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Terminated: ok {rc=0} 13:19:16.047617 bus /gobi_0: Setting Powered False 13:19:17.151851 bus /gobi_0: Setting Powered False 13:19:18.277461 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:trx-b200 --------------------------------------------------------------------- 13:19:19.513337 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:19.517839 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:19:19.551723 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:19:19.560404 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:19:19.613544 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:19:19.647466 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:19:19.654981 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:19:20.196264 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:19:20.201856 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 13:19:20.213121 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 13:19:20.267524 tst mo_mt_sms.py: using LAC 34209 13:19:20.394209 tst mo_mt_sms.py: using RAC 39 13:19:20.521316 tst mo_mt_sms.py: using CellId 34209 13:19:20.649209 tst mo_mt_sms.py: using BVCI 34210 13:19:20.758904 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:19:20.878517 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:19:20.996649 tst mo_mt_sms.py:9: start nitb and bts... 13:19:21.214216 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:19:21.870697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25457): Launched 13:19:22.194280 run osmo-nitb_10.42.42.2(pid=25458): Launched 13:19:22.374009 run osmo-nitb_10.42.42.2(pid=25458): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25458)] 13:19:22.518638 run osmo-nitb_10.42.42.2(pid=25458): stdout: | (launched: 2022-12-13_13:19:22.135195) 13:19:22.665746 run osmo-nitb_10.42.42.2(pid=25458): stderr: | (launched: 2022-12-13_13:19:22.183038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:19:22.811568 run osmo-nitb_10.42.42.2(pid=25458): stdout: | (launched: 2022-12-13_13:19:22.135195) 13:19:22.951722 run osmo-nitb_10.42.42.2(pid=25458): stderr: | (launched: 2022-12-13_13:19:22.183038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25458) [trial-2390↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25458)] 13:19:23.317034 tst osmo-nitb_10.42.42.2(pid=25458): stdout: | (launched: 2022-12-13_13:19:22.135195) 13:19:23.446542 tst osmo-nitb_10.42.42.2(pid=25458): stderr: | (launched: 2022-12-13_13:19:22.183038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:19:23.599648 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25458) [trial-2390↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25458)] [trial-2390↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 13:19:23.609735 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:19:23.617263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25457): Terminating (SIGTERM) 13:19:23.829395 --- ParallelTerminationStrategy: PID 25457 died... 13:19:23.851772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25457): Terminated: ok {rc=0} 13:19:23.940754 bus /sierra_3: Setting Powered False 13:19:25.041749 bus /sierra_3: Setting Powered False 13:19:26.160461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:trx-b200 --------------------------------------------------------------------- 13:19:27.354479 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:27.358632 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:19:27.391542 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:19:27.419331 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:19:27.475112 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:19:27.508252 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:19:27.535005 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:19:28.076888 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:19:28.082163 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.092749 tst sms:trx-b200: Using 1 x bts (candidates: 1) 13:19:28.140346 tst mo_mt_sms.py: using LAC 34210 13:19:28.261490 tst mo_mt_sms.py: using RAC 40 13:19:28.379931 tst mo_mt_sms.py: using CellId 34210 13:19:28.495551 tst mo_mt_sms.py: using BVCI 34211 13:19:28.604305 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.614966 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.625865 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.636253 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.646841 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:28.657428 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:19:28.777847 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:19:28.898129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:29.365274 run create_hlr_db(pid=25462): Launched 13:19:29.487834 bus /sierra_2: Setting Powered False 13:19:30.547442 run create_hlr_db(pid=25462): Terminated: ok {rc=0} 13:19:31.017702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25464): Launched 13:19:31.329650 run osmo-hlr_10.42.42.2(pid=25465): Launched 13:19:31.600047 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:32.282735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25467): Launched 13:19:32.613176 run osmo-stp_10.42.42.5(pid=25468): Launched 13:19:32.736758 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:33.315623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25470): Launched 13:19:33.637927 run osmo-msc_10.42.42.6(pid=25471): Launched 13:19:33.819149 run osmo-stp_10.42.42.5(pid=25468): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25468)] 13:19:33.954801 run osmo-stp_10.42.42.5(pid=25468): stdout: | (launched: 2022-12-13_13:19:32.554091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:34.092040 run osmo-stp_10.42.42.5(pid=25468): stderr: | 20221213131932745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131932745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131932745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131932745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131932746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131932746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131932746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:34.227498 run osmo-stp_10.42.42.5(pid=25468): stdout: | (launched: 2022-12-13_13:19:32.554091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:34.356316 run osmo-stp_10.42.42.5(pid=25468): stderr: | 20221213131932745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131932745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131932745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131932745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131932746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131932746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131932746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:34.510054 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25468): Process ended prematurely: osmo-stp_10.42.42.5(pid=25468) [trial-2390↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25468)] [trial-2390↪sms:trx-b200↪mo_mt_sms.py:16] 13:19:34.519205 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 13:19:34.546672 run osmo-hlr_10.42.42.2(pid=25465): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25465)] 13:19:34.598471 run osmo-hlr_10.42.42.2(pid=25465): stdout: | (launched: 2022-12-13_13:19:31.267062) 13:19:34.651720 run osmo-hlr_10.42.42.2(pid=25465): stderr: | 20221213131931508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131931508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131931508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131931508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131931508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131931508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131931521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131931538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131931538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131931538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:34.725405 run osmo-msc_10.42.42.6(pid=25471): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25471)] 13:19:34.775767 run osmo-msc_10.42.42.6(pid=25471): stdout: | (launched: 2022-12-13_13:19:33.578258) 13:19:34.828562 run osmo-msc_10.42.42.6(pid=25471): stderr: | 20221213131933899 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131933899 DLGLOBAL DEBUG validating counter group 0x7f30b3a72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131933899 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131933899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131933899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131933900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131933901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131933902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131933902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131933902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:34.881825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25464): Terminating (SIGTERM) 13:19:34.923758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25467): Terminating (SIGTERM) 13:19:34.966500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25470): Terminating (SIGTERM) 13:19:35.009523 --- ParallelTerminationStrategy: PID 25464 died... 13:19:35.030272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25464): Terminated: ok {rc=0} 13:19:35.077488 --- ParallelTerminationStrategy: PID 25467 died... 13:19:35.097783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25467): Terminated: ok {rc=0} 13:19:35.144759 --- ParallelTerminationStrategy: PID 25470 died... 13:19:35.165157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25470): Terminated: ok {rc=0} 13:19:35.254867 bus /sierra_3: Setting Powered False 13:19:36.353804 bus /sierra_3: Setting Powered False 13:19:37.470495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-b200 --------------------------------------------------------------------- 13:19:38.701276 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:38.705792 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:19:38.739802 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:19:38.749620 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:19:38.785264 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:19:38.818562 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:19:38.825572 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:19:39.347009 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:19:39.354373 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 13:19:39.366614 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 13:19:39.417817 tst assert_extension.py: using LAC 34211 13:19:39.543979 tst assert_extension.py: using RAC 41 13:19:39.662667 tst assert_extension.py: using CellId 34211 13:19:39.781625 tst assert_extension.py: using BVCI 34212 13:19:39.892107 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 13:19:40.013344 tst assert_extension.py:10: start nitb and bts... 13:19:40.214546 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:19:40.828395 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25476): Launched 13:19:41.128265 run osmo-nitb_10.42.42.2(pid=25477): Launched 13:19:41.293810 run osmo-nitb_10.42.42.2(pid=25477): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25477)] 13:19:41.428096 run osmo-nitb_10.42.42.2(pid=25477): stdout: | (launched: 2022-12-13_13:19:41.072842) 13:19:41.563759 run osmo-nitb_10.42.42.2(pid=25477): stderr: | (launched: 2022-12-13_13:19:41.117279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:19:41.699657 run osmo-nitb_10.42.42.2(pid=25477): stdout: | (launched: 2022-12-13_13:19:41.072842) 13:19:41.830110 run osmo-nitb_10.42.42.2(pid=25477): stderr: | (launched: 2022-12-13_13:19:41.117279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25477) [trial-2390↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25477)] 13:19:42.241252 tst osmo-nitb_10.42.42.2(pid=25477): stdout: | (launched: 2022-12-13_13:19:41.072842) 13:19:42.361579 tst osmo-nitb_10.42.42.2(pid=25477): stderr: | (launched: 2022-12-13_13:19:41.117279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:19:42.503443 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25477) [trial-2390↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25477)] [trial-2390↪nitb_ussd:trx-b200↪assert_extension.py:12] 13:19:42.512147 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:19:42.518991 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25476): Terminating (SIGTERM) 13:19:42.728524 --- ParallelTerminationStrategy: PID 25476 died... 13:19:42.749666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25476): Terminated: ok {rc=0} 13:19:42.834677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:trx-b200 --------------------------------------------------------------------- 13:19:44.009864 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:44.013934 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:19:44.046308 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:19:44.073398 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:19:44.109338 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:19:44.142539 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:19:44.169457 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:19:44.697403 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:19:44.702497 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:44.713169 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 13:19:44.760116 tst assert_extension.py: using LAC 34212 13:19:44.877743 tst assert_extension.py: using RAC 42 13:19:44.994122 tst assert_extension.py: using CellId 34212 13:19:45.113120 tst assert_extension.py: using BVCI 34213 13:19:45.220535 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:45.231060 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:45.241506 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:45.251821 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:45.262161 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:19:45.273032 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 13:19:45.392374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:45.893615 run create_hlr_db(pid=25481): Launched 13:19:46.031932 bus /sierra_2: Setting Powered False 13:19:47.107592 run create_hlr_db(pid=25481): Terminated: ok {rc=0} 13:19:47.557689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Launched 13:19:47.863035 run osmo-hlr_10.42.42.2(pid=25484): Launched 13:19:47.978686 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:48.511457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Launched 13:19:48.812637 run osmo-stp_10.42.42.5(pid=25487): Launched 13:19:48.926308 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:49.468133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Launched 13:19:49.767032 run osmo-msc_10.42.42.6(pid=25490): Launched 13:19:49.935043 run osmo-stp_10.42.42.5(pid=25487): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] 13:19:50.060941 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-13_13:19:48.756054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:50.187742 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221213131948925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131948925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131948926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131948926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131948927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131948927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131948927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:50.312194 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-13_13:19:48.756054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:50.430528 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221213131948925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131948925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131948926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131948926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131948927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131948927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131948927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:50.572495 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2390↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] [trial-2390↪ussd:trx-b200↪assert_extension.py:17] 13:19:50.581090 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:19:50.607116 run osmo-hlr_10.42.42.2(pid=25484): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25484)] 13:19:50.654910 run osmo-hlr_10.42.42.2(pid=25484): stdout: | (launched: 2022-12-13_13:19:47.806911) 13:19:50.704136 run osmo-hlr_10.42.42.2(pid=25484): stderr: | 20221213131947982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131947982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131947982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131947982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131947982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131947982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131947994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131948003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131948004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131948004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:50.772685 run osmo-msc_10.42.42.6(pid=25490): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25490)] 13:19:50.820549 run osmo-msc_10.42.42.6(pid=25490): stdout: | (launched: 2022-12-13_13:19:49.711185) 13:19:50.869744 run osmo-msc_10.42.42.6(pid=25490): stderr: | 20221213131949981 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131949981 DLGLOBAL DEBUG validating counter group 0x7f64696b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131949981 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131949982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131949982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131949982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131949984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131949984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131949984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131949984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:50.919452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminating (SIGTERM) 13:19:50.959298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminating (SIGTERM) 13:19:50.998979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Terminating (SIGTERM) 13:19:51.038842 --- ParallelTerminationStrategy: PID 25483 died... 13:19:51.058305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminated: ok {rc=0} 13:19:51.102033 --- ParallelTerminationStrategy: PID 25486 died... 13:19:51.120647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminated: ok {rc=0} 13:19:51.164271 --- ParallelTerminationStrategy: PID 25489 died... 13:19:51.182873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Terminated: ok {rc=0} 13:19:51.268333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:19:52.480607 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:52.487072 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:19:52.519678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:19:52.546174 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:19:52.599829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:19:52.632692 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:19:52.659582 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:19:53.209958 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:19:53.266502 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.278272 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:19:53.351000 tst mo_mt_call.py: using LAC 34213 13:19:53.479544 tst mo_mt_call.py: using RAC 43 13:19:53.601144 tst mo_mt_call.py: using CellId 34213 13:19:53.723752 tst mo_mt_call.py: using BVCI 34214 13:19:53.836557 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.847811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.858883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.869827 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.880831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:19:53.891760 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:19:54.008516 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:19:54.129031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:54.636144 run create_hlr_db(pid=25495): Launched 13:19:54.762247 bus /sierra_2: Setting Powered False 13:19:55.826939 run create_hlr_db(pid=25495): Terminated: ok {rc=0} 13:19:56.263566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Launched 13:19:56.569974 run osmo-hlr_10.42.42.2(pid=25498): Launched 13:19:56.689512 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:57.220548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Launched 13:19:57.526527 run osmo-stp_10.42.42.5(pid=25501): Launched 13:19:57.644931 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:58.198213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Launched 13:19:58.505653 run osmo-msc_10.42.42.6(pid=25504): Launched 13:19:58.680420 run osmo-stp_10.42.42.5(pid=25501): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] 13:19:58.809875 run osmo-stp_10.42.42.5(pid=25501): stdout: | (launched: 2022-12-13_13:19:57.469714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:58.940172 run osmo-stp_10.42.42.5(pid=25501): stderr: | 20221213131957636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131957636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131957636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131957637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131957637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131957638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131957638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:59.068178 run osmo-stp_10.42.42.5(pid=25501): stdout: | (launched: 2022-12-13_13:19:57.469714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:59.189803 run osmo-stp_10.42.42.5(pid=25501): stderr: | 20221213131957636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213131957636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213131957636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213131957637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213131957637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213131957638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213131957638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:59.335274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25501): Process ended prematurely: osmo-stp_10.42.42.5(pid=25501) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:19:59.344364 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:19:59.370775 run osmo-hlr_10.42.42.2(pid=25498): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25498)] 13:19:59.418799 run osmo-hlr_10.42.42.2(pid=25498): stdout: | (launched: 2022-12-13_13:19:56.513085) 13:19:59.468494 run osmo-hlr_10.42.42.2(pid=25498): stderr: | 20221213131956689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213131956689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213131956689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213131956689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213131956689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213131956689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213131956701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213131956710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213131956710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213131956710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:59.538559 run osmo-msc_10.42.42.6(pid=25504): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25504)] 13:19:59.586715 run osmo-msc_10.42.42.6(pid=25504): stdout: | (launched: 2022-12-13_13:19:58.448503) 13:19:59.636385 run osmo-msc_10.42.42.6(pid=25504): stderr: | 20221213131958719 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213131958719 DLGLOBAL DEBUG validating counter group 0x7f2abbed2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213131958719 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213131958719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213131958720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213131958720 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213131958721 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213131958722 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213131958722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213131958722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:59.686552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Terminating (SIGTERM) 13:19:59.726425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Terminating (SIGTERM) 13:19:59.766363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Terminating (SIGTERM) 13:19:59.806359 --- ParallelTerminationStrategy: PID 25497 died... 13:19:59.825575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Terminated: ok {rc=0} 13:19:59.869880 --- ParallelTerminationStrategy: PID 25500 died... 13:19:59.888393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Terminated: ok {rc=0} 13:19:59.932386 --- ParallelTerminationStrategy: PID 25503 died... 13:19:59.951159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Terminated: ok {rc=0} 13:20:00.035251 bus /sierra_3: Setting Powered False 13:20:01.140022 bus /sierra_3: Setting Powered False 13:20:02.282776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:20:03.433539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:03.445675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:20:03.517606 tst mo_mt_call_osmux.py: using LAC 34214 13:20:03.643345 tst mo_mt_call_osmux.py: using RAC 44 13:20:03.765507 tst mo_mt_call_osmux.py: using CellId 34214 13:20:03.885369 tst mo_mt_call_osmux.py: using BVCI 34215 13:20:03.996226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:04.007512 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:04.018697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:04.029751 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:04.041225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:20:04.052372 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:20:04.172000 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:20:04.294725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:04.768502 run create_hlr_db(pid=25509): Launched 13:20:04.893724 bus /sierra_2: Setting Powered False 13:20:05.954158 run create_hlr_db(pid=25509): Terminated: ok {rc=0} 13:20:06.400438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Launched 13:20:06.729693 run osmo-hlr_10.42.42.2(pid=25512): Launched 13:20:06.855559 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:07.425655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Launched 13:20:07.754554 run osmo-stp_10.42.42.5(pid=25515): Launched 13:20:07.880611 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:08.470949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Launched 13:20:08.798861 run osmo-msc_10.42.42.6(pid=25518): Launched 13:20:08.982557 run osmo-stp_10.42.42.5(pid=25515): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] 13:20:09.120185 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-13_13:20:07.694252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:09.258826 run osmo-stp_10.42.42.5(pid=25515): stderr: | 20221213132007884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132007884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132007885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132007885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132007885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132007886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132007886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:09.395745 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-13_13:20:07.694252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:09.524864 run osmo-stp_10.42.42.5(pid=25515): stderr: | 20221213132007884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132007884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132007885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132007885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132007885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132007886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132007886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:09.680852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:20:09.690603 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:20:09.718418 run osmo-hlr_10.42.42.2(pid=25512): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25512)] 13:20:09.769215 run osmo-hlr_10.42.42.2(pid=25512): stdout: | (launched: 2022-12-13_13:20:06.669329) 13:20:09.821964 run osmo-hlr_10.42.42.2(pid=25512): stderr: | 20221213132006864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132006864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132006865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132006865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132006865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132006865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132006876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132006887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132006887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132006887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:09.894607 run osmo-msc_10.42.42.6(pid=25518): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25518)] 13:20:09.944312 run osmo-msc_10.42.42.6(pid=25518): stdout: | (launched: 2022-12-13_13:20:08.738714) 13:20:09.996053 run osmo-msc_10.42.42.6(pid=25518): stderr: | 20221213132009059 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132009059 DLGLOBAL DEBUG validating counter group 0x7f45d70b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132009060 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132009060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132009060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132009060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132009062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132009062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132009062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132009062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:10.048606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminating (SIGTERM) 13:20:10.090418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminating (SIGTERM) 13:20:10.132622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Terminating (SIGTERM) 13:20:10.175013 --- ParallelTerminationStrategy: PID 25511 died... 13:20:10.195224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminated: ok {rc=0} 13:20:10.241724 --- ParallelTerminationStrategy: PID 25514 died... 13:20:10.261531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminated: ok {rc=0} 13:20:10.307700 --- ParallelTerminationStrategy: PID 25517 died... 13:20:10.327714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Terminated: ok {rc=0} 13:20:10.416250 bus /sierra_3: Setting Powered False 13:20:11.515568 bus /sierra_3: Setting Powered False 13:20:12.632862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:20:13.883070 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:13.890132 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:20:13.923279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:20:13.950246 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:20:14.001675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:20:14.035017 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:20:14.061539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:20:14.611898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:20:14.660373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:14.671405 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:20:14.740453 tst mo_mt_call.py: using LAC 34215 13:20:14.861861 tst mo_mt_call.py: using RAC 45 13:20:14.982431 tst mo_mt_call.py: using CellId 34215 13:20:15.103865 tst mo_mt_call.py: using BVCI 34216 13:20:15.216473 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:15.227556 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:15.238514 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:15.249424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:15.260353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:15.271332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:20:15.393543 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:20:15.512235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:15.989750 run create_hlr_db(pid=25524): Launched 13:20:16.163080 bus /sierra_2: Setting Powered False 13:20:17.231797 run create_hlr_db(pid=25524): Terminated: ok {rc=0} 13:20:17.687802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Launched 13:20:18.017928 run osmo-hlr_10.42.42.2(pid=25527): Launched 13:20:18.143366 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:18.705716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Launched 13:20:19.035506 run osmo-stp_10.42.42.5(pid=25530): Launched 13:20:19.162567 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:19.753369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25532): Launched 13:20:20.084310 run osmo-msc_10.42.42.6(pid=25533): Launched 13:20:20.265952 run osmo-stp_10.42.42.5(pid=25530): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] 13:20:20.408792 run osmo-stp_10.42.42.5(pid=25530): stdout: | (launched: 2022-12-13_13:20:18.974818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:20.547943 run osmo-stp_10.42.42.5(pid=25530): stderr: | 20221213132019164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132019165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132019165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132019165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132019166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132019166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132019166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:20.685181 run osmo-stp_10.42.42.5(pid=25530): stdout: | (launched: 2022-12-13_13:20:18.974818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:20.814996 run osmo-stp_10.42.42.5(pid=25530): stderr: | 20221213132019164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132019165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132019165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132019165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132019166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132019166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132019166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:20.970750 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25530): Process ended prematurely: osmo-stp_10.42.42.5(pid=25530) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:20:20.980361 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:20:21.008471 run osmo-hlr_10.42.42.2(pid=25527): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25527)] 13:20:21.060212 run osmo-hlr_10.42.42.2(pid=25527): stdout: | (launched: 2022-12-13_13:20:17.957548) 13:20:21.112495 run osmo-hlr_10.42.42.2(pid=25527): stderr: | 20221213132018155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132018155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132018155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132018155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132018155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132018155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132018168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132018176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132018176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132018176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:21.185398 run osmo-msc_10.42.42.6(pid=25533): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25533)] 13:20:21.235685 run osmo-msc_10.42.42.6(pid=25533): stdout: | (launched: 2022-12-13_13:20:20.023524) 13:20:21.287851 run osmo-msc_10.42.42.6(pid=25533): stderr: | 20221213132020344 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132020344 DLGLOBAL DEBUG validating counter group 0x7f0bb8092c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132020344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132020344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132020344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132020344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132020346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132020346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132020347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132020347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:21.340315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Terminating (SIGTERM) 13:20:21.382626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Terminating (SIGTERM) 13:20:21.425627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25532): Terminating (SIGTERM) 13:20:21.468444 --- ParallelTerminationStrategy: PID 25526 died... 13:20:21.489035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Terminated: ok {rc=0} 13:20:21.536051 --- ParallelTerminationStrategy: PID 25529 died... 13:20:21.556238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Terminated: ok {rc=0} 13:20:21.603296 --- ParallelTerminationStrategy: PID 25532 died... 13:20:21.623873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25532): Terminated: ok {rc=0} 13:20:21.714636 bus /sierra_3: Setting Powered False 13:20:22.814622 bus /sierra_3: Setting Powered False 13:20:23.933569 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:20:25.081111 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.093080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:20:25.162612 tst mo_mt_call_osmux.py: using LAC 34216 13:20:25.284606 tst mo_mt_call_osmux.py: using RAC 46 13:20:25.413789 tst mo_mt_call_osmux.py: using CellId 34216 13:20:25.542706 tst mo_mt_call_osmux.py: using BVCI 34217 13:20:25.664069 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.675895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.687686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.699381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.711314 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:20:25.723118 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:20:25.840024 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:20:25.962068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:26.469393 run create_hlr_db(pid=25535): Launched 13:20:26.595900 bus /sierra_2: Setting Powered False 13:20:27.660263 run create_hlr_db(pid=25535): Terminated: ok {rc=0} 13:20:28.098275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Launched 13:20:28.405233 run osmo-hlr_10.42.42.2(pid=25538): Launched 13:20:28.521981 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:29.050348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Launched 13:20:29.356859 run osmo-stp_10.42.42.5(pid=25541): Launched 13:20:29.472936 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:30.031632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Launched 13:20:30.340347 run osmo-msc_10.42.42.6(pid=25544): Launched 13:20:30.511714 run osmo-stp_10.42.42.5(pid=25541): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] 13:20:30.641189 run osmo-stp_10.42.42.5(pid=25541): stdout: | (launched: 2022-12-13_13:20:29.300306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:30.770940 run osmo-stp_10.42.42.5(pid=25541): stderr: | 20221213132029468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132029468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132029468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132029469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132029469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132029469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132029469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:30.922981 run osmo-stp_10.42.42.5(pid=25541): stdout: | (launched: 2022-12-13_13:20:29.300306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:31.046928 run osmo-stp_10.42.42.5(pid=25541): stderr: | 20221213132029468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132029468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132029468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132029469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132029469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132029469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132029469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:31.231926 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25541): Process ended prematurely: osmo-stp_10.42.42.5(pid=25541) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:20:31.241509 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:20:31.269056 run osmo-hlr_10.42.42.2(pid=25538): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25538)] 13:20:31.318332 run osmo-hlr_10.42.42.2(pid=25538): stdout: | (launched: 2022-12-13_13:20:28.348277) 13:20:31.369466 run osmo-hlr_10.42.42.2(pid=25538): stderr: | 20221213132028525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132028525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132028525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132028525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132028525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132028525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132028537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132028546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132028546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132028547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:31.440653 run osmo-msc_10.42.42.6(pid=25544): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25544)] 13:20:31.490163 run osmo-msc_10.42.42.6(pid=25544): stdout: | (launched: 2022-12-13_13:20:30.283350) 13:20:31.541988 run osmo-msc_10.42.42.6(pid=25544): stderr: | 20221213132030553 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132030553 DLGLOBAL DEBUG validating counter group 0x7ffa48801c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132030553 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132030553 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132030553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132030554 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132030555 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132030556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132030556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132030556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:31.594236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Terminating (SIGTERM) 13:20:31.636049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Terminating (SIGTERM) 13:20:31.678339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Terminating (SIGTERM) 13:20:31.722457 --- ParallelTerminationStrategy: PID 25537 died... 13:20:31.742890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Terminated: ok {rc=0} 13:20:31.789631 --- ParallelTerminationStrategy: PID 25540 died... 13:20:31.809180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Terminated: ok {rc=0} 13:20:31.854320 --- ParallelTerminationStrategy: PID 25543 died... 13:20:31.875018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Terminated: ok {rc=0} 13:20:31.992937 bus /sierra_3: Setting Powered False 13:20:33.109247 bus /sierra_3: Setting Powered False 13:20:34.224765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:20:35.480604 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:35.487596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:20:35.520619 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:20:35.547722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:20:35.597915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:20:35.630548 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:20:35.656919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:20:36.209884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:20:36.258600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.269767 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:20:36.337371 tst mo_mt_call.py: using LAC 34217 13:20:36.459011 tst mo_mt_call.py: using RAC 47 13:20:36.579803 tst mo_mt_call.py: using CellId 34217 13:20:36.699385 tst mo_mt_call.py: using BVCI 34218 13:20:36.811760 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.822906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.833804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.844630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.855537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:36.866427 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:20:36.988917 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:20:37.107194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:37.584426 run create_hlr_db(pid=25550): Launched 13:20:37.708735 bus /sierra_2: Setting Powered False 13:20:38.769510 run create_hlr_db(pid=25550): Terminated: ok {rc=0} 13:20:39.217328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25552): Launched 13:20:39.545930 run osmo-hlr_10.42.42.2(pid=25553): Launched 13:20:39.673216 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:40.241636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25555): Launched 13:20:40.571829 run osmo-stp_10.42.42.5(pid=25556): Launched 13:20:40.698315 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:41.291064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25558): Launched 13:20:41.621423 run osmo-msc_10.42.42.6(pid=25559): Launched 13:20:41.805425 run osmo-stp_10.42.42.5(pid=25556): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25556)] 13:20:42.008421 run osmo-stp_10.42.42.5(pid=25556): stdout: | (launched: 2022-12-13_13:20:40.511308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:42.148257 run osmo-stp_10.42.42.5(pid=25556): stderr: | 20221213132040703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132040703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132040703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132040704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132040704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132040704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132040704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:42.286760 run osmo-stp_10.42.42.5(pid=25556): stdout: | (launched: 2022-12-13_13:20:40.511308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:42.417954 run osmo-stp_10.42.42.5(pid=25556): stderr: | 20221213132040703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132040703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132040703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132040704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132040704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132040704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132040704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:42.575527 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25556): Process ended prematurely: osmo-stp_10.42.42.5(pid=25556) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25556)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:20:42.585398 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:20:42.613442 run osmo-hlr_10.42.42.2(pid=25553): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25553)] 13:20:42.665258 run osmo-hlr_10.42.42.2(pid=25553): stdout: | (launched: 2022-12-13_13:20:39.485673) 13:20:42.717965 run osmo-hlr_10.42.42.2(pid=25553): stderr: | 20221213132039682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132039682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132039682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132039682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132039682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132039682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132039699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132039709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132039709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132039709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:42.790817 run osmo-msc_10.42.42.6(pid=25559): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25559)] 13:20:42.841919 run osmo-msc_10.42.42.6(pid=25559): stdout: | (launched: 2022-12-13_13:20:41.560747) 13:20:42.894584 run osmo-msc_10.42.42.6(pid=25559): stderr: | 20221213132041880 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132041880 DLGLOBAL DEBUG validating counter group 0x7f19133d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132041880 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132041880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132041881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132041881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132041884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132041884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132041884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132041884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:42.947751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25552): Terminating (SIGTERM) 13:20:42.989998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25555): Terminating (SIGTERM) 13:20:43.032933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25558): Terminating (SIGTERM) 13:20:43.075791 --- ParallelTerminationStrategy: PID 25552 died... 13:20:43.096432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25552): Terminated: ok {rc=0} 13:20:43.143560 --- ParallelTerminationStrategy: PID 25555 died... 13:20:43.163563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25555): Terminated: ok {rc=0} 13:20:43.211101 --- ParallelTerminationStrategy: PID 25558 died... 13:20:43.231437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25558): Terminated: ok {rc=0} 13:20:43.321772 bus /sierra_3: Setting Powered False 13:20:44.421392 bus /sierra_3: Setting Powered False 13:20:45.538764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:20:46.684002 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:46.697471 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:20:46.768452 tst mo_mt_call_osmux.py: using LAC 34218 13:20:46.900073 tst mo_mt_call_osmux.py: using RAC 48 13:20:47.022692 tst mo_mt_call_osmux.py: using CellId 34218 13:20:47.154086 tst mo_mt_call_osmux.py: using BVCI 34219 13:20:47.277847 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:47.290186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:47.302352 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:47.314471 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:47.327348 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:20:47.339791 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:20:47.461367 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:20:47.583633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:48.092152 run create_hlr_db(pid=25561): Launched 13:20:48.218433 bus /sierra_2: Setting Powered False 13:20:49.279651 run create_hlr_db(pid=25561): Terminated: ok {rc=0} 13:20:49.734894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Launched 13:20:50.064029 run osmo-hlr_10.42.42.2(pid=25564): Launched 13:20:50.188477 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:50.757483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Launched 13:20:51.087309 run osmo-stp_10.42.42.5(pid=25567): Launched 13:20:51.212756 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:51.803447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Launched 13:20:52.116259 run osmo-msc_10.42.42.6(pid=25571): Launched 13:20:52.286049 run osmo-stp_10.42.42.5(pid=25567): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] 13:20:52.415003 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-13_13:20:51.026687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:52.543283 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221213132051215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132051216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132051216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132051216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132051217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132051217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132051217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:52.670774 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-13_13:20:51.026687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:52.791258 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221213132051215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132051216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132051216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132051216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132051217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132051217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132051217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:52.936559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:20:52.945647 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:20:52.971925 run osmo-hlr_10.42.42.2(pid=25564): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25564)] 13:20:53.019314 run osmo-hlr_10.42.42.2(pid=25564): stdout: | (launched: 2022-12-13_13:20:50.003637) 13:20:53.069133 run osmo-hlr_10.42.42.2(pid=25564): stderr: | 20221213132050201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132050201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132050201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132050201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132050202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132050202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132050214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132050222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132050223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132050223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:53.137529 run osmo-msc_10.42.42.6(pid=25571): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25571)] 13:20:53.184849 run osmo-msc_10.42.42.6(pid=25571): stdout: | (launched: 2022-12-13_13:20:52.059293) 13:20:53.233888 run osmo-msc_10.42.42.6(pid=25571): stderr: | 20221213132052330 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132052330 DLGLOBAL DEBUG validating counter group 0x7f9355ccac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132052330 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132052330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132052330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132052330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132052332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132052332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132052333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132052333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:53.283261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminating (SIGTERM) 13:20:53.323662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminating (SIGTERM) 13:20:53.363208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminating (SIGTERM) 13:20:53.403010 --- ParallelTerminationStrategy: PID 25563 died... 13:20:53.422125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminated: ok {rc=0} 13:20:53.465904 --- ParallelTerminationStrategy: PID 25566 died... 13:20:53.484450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminated: ok {rc=0} 13:20:53.528105 --- ParallelTerminationStrategy: PID 25569 died... 13:20:53.546719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminated: ok {rc=0} 13:20:53.632569 bus /sierra_3: Setting Powered False 13:20:54.731779 bus /sierra_3: Setting Powered False 13:20:55.846996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:20:57.103103 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:57.109915 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:20:57.142761 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:20:57.169319 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:20:57.219744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:20:57.253235 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:20:57.280258 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:20:57.834564 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:20:57.885992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:57.897528 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:20:57.964603 tst mo_mt_call.py: using LAC 34219 13:20:58.092538 tst mo_mt_call.py: using RAC 49 13:20:58.219880 tst mo_mt_call.py: using CellId 34219 13:20:58.346992 tst mo_mt_call.py: using BVCI 34220 13:20:58.466230 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:58.477816 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:58.489262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:58.500614 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:58.512937 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:20:58.525302 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:20:58.645723 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:20:58.768576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:59.276302 run create_hlr_db(pid=25576): Launched 13:20:59.403871 bus /sierra_2: Setting Powered False 13:21:00.468896 run create_hlr_db(pid=25576): Terminated: ok {rc=0} 13:21:00.936526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25578): Launched 13:21:01.282481 run osmo-hlr_10.42.42.2(pid=25579): Launched 13:21:01.604355 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:02.176412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25581): Launched 13:21:02.499619 run osmo-stp_10.42.42.5(pid=25582): Launched 13:21:02.617859 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:03.175510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25584): Launched 13:21:03.482996 run osmo-msc_10.42.42.6(pid=25585): Launched 13:21:03.654105 run osmo-stp_10.42.42.5(pid=25582): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25582)] 13:21:03.782623 run osmo-stp_10.42.42.5(pid=25582): stdout: | (launched: 2022-12-13_13:21:02.442732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:03.911710 run osmo-stp_10.42.42.5(pid=25582): stderr: | 20221213132102610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132102610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132102611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132102611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132102611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132102612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132102612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:04.038720 run osmo-stp_10.42.42.5(pid=25582): stdout: | (launched: 2022-12-13_13:21:02.442732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:04.159747 run osmo-stp_10.42.42.5(pid=25582): stderr: | 20221213132102610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132102610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132102611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132102611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132102611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132102612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132102612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:04.304327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25582): Process ended prematurely: osmo-stp_10.42.42.5(pid=25582) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25582)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:21:04.313380 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:21:04.339318 run osmo-hlr_10.42.42.2(pid=25579): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25579)] 13:21:04.386562 run osmo-hlr_10.42.42.2(pid=25579): stdout: | (launched: 2022-12-13_13:21:01.223433) 13:21:04.435412 run osmo-hlr_10.42.42.2(pid=25579): stderr: | 20221213132101418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132101418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132101418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132101419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132101419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132101419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132101433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132101447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132101448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132101448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:04.503418 run osmo-msc_10.42.42.6(pid=25585): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25585)] 13:21:04.550692 run osmo-msc_10.42.42.6(pid=25585): stdout: | (launched: 2022-12-13_13:21:03.426344) 13:21:04.599842 run osmo-msc_10.42.42.6(pid=25585): stderr: | 20221213132103699 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132103699 DLGLOBAL DEBUG validating counter group 0x7f9da9ee2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132103699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132103699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132103699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132103699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132103701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132103702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132103702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132103702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:04.649327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25578): Terminating (SIGTERM) 13:21:04.689088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25581): Terminating (SIGTERM) 13:21:04.728565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25584): Terminating (SIGTERM) 13:21:04.768444 --- ParallelTerminationStrategy: PID 25578 died... 13:21:04.787630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25578): Terminated: ok {rc=0} 13:21:04.831371 --- ParallelTerminationStrategy: PID 25581 died... 13:21:04.849933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25581): Terminated: ok {rc=0} 13:21:04.893870 --- ParallelTerminationStrategy: PID 25584 died... 13:21:04.912488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25584): Terminated: ok {rc=0} 13:21:04.998009 bus /sierra_3: Setting Powered False 13:21:06.099086 bus /sierra_3: Setting Powered False 13:21:07.214820 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:21:08.361101 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.372618 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:21:08.441501 tst mo_mt_call_osmux.py: using LAC 34220 13:21:08.564173 tst mo_mt_call_osmux.py: using RAC 50 13:21:08.683492 tst mo_mt_call_osmux.py: using CellId 34220 13:21:08.802853 tst mo_mt_call_osmux.py: using BVCI 34221 13:21:08.915619 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.926774 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.937756 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.948528 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.959503 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:21:08.970474 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:21:09.087197 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:21:09.208140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:09.716216 run create_hlr_db(pid=25587): Launched 13:21:09.842411 bus /sierra_2: Setting Powered False 13:21:10.906510 run create_hlr_db(pid=25587): Terminated: ok {rc=0} 13:21:11.343330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Launched 13:21:11.650349 run osmo-hlr_10.42.42.2(pid=25590): Launched 13:21:11.768792 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:12.309013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Launched 13:21:12.614819 run osmo-stp_10.42.42.5(pid=25593): Launched 13:21:12.730314 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:13.282960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Launched 13:21:13.589988 run osmo-msc_10.42.42.6(pid=25596): Launched 13:21:13.760390 run osmo-stp_10.42.42.5(pid=25593): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] 13:21:13.890442 run osmo-stp_10.42.42.5(pid=25593): stdout: | (launched: 2022-12-13_13:21:12.558068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:14.019580 run osmo-stp_10.42.42.5(pid=25593): stderr: | 20221213132112726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132112727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132112727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132112727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132112728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132112728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132112728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:14.146731 run osmo-stp_10.42.42.5(pid=25593): stdout: | (launched: 2022-12-13_13:21:12.558068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:14.267454 run osmo-stp_10.42.42.5(pid=25593): stderr: | 20221213132112726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132112727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132112727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132112727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132112728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132112728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132112728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:14.411823 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25593): Process ended prematurely: osmo-stp_10.42.42.5(pid=25593) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:21:14.420807 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:21:14.447180 run osmo-hlr_10.42.42.2(pid=25590): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25590)] 13:21:14.495127 run osmo-hlr_10.42.42.2(pid=25590): stdout: | (launched: 2022-12-13_13:21:11.593812) 13:21:14.544583 run osmo-hlr_10.42.42.2(pid=25590): stderr: | 20221213132111767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132111768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132111768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132111768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132111768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132111768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132111780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132111790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132111791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132111791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:14.613712 run osmo-msc_10.42.42.6(pid=25596): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25596)] 13:21:14.661595 run osmo-msc_10.42.42.6(pid=25596): stdout: | (launched: 2022-12-13_13:21:13.532839) 13:21:14.711016 run osmo-msc_10.42.42.6(pid=25596): stderr: | 20221213132113804 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132113804 DLGLOBAL DEBUG validating counter group 0x7fef76324c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132113804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132113804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132113804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132113805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132113806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132113807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132113807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132113807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:14.760748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Terminating (SIGTERM) 13:21:14.800900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Terminating (SIGTERM) 13:21:14.841118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Terminating (SIGTERM) 13:21:14.881347 --- ParallelTerminationStrategy: PID 25589 died... 13:21:14.900521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Terminated: ok {rc=0} 13:21:14.944910 --- ParallelTerminationStrategy: PID 25592 died... 13:21:14.964065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Terminated: ok {rc=0} 13:21:15.008190 --- ParallelTerminationStrategy: PID 25595 died... 13:21:15.026965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Terminated: ok {rc=0} 13:21:15.113244 bus /sierra_3: Setting Powered False 13:21:16.224929 bus /sierra_3: Setting Powered False 13:21:17.358947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:21:18.609944 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:18.616694 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:21:18.649902 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:21:18.676882 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:21:18.729985 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:21:18.763329 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:21:18.789796 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:21:19.338927 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:21:19.388457 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:19.399643 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:21:19.469620 tst mo_mt_call.py: using LAC 34221 13:21:19.592480 tst mo_mt_call.py: using RAC 51 13:21:19.714252 tst mo_mt_call.py: using CellId 34221 13:21:19.836003 tst mo_mt_call.py: using BVCI 34222 13:21:19.947965 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:19.958985 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:19.969925 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:19.980754 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:19.991717 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:20.003106 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:21:20.124842 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:21:20.242736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:20.714888 run create_hlr_db(pid=25603): Launched 13:21:20.841418 bus /sierra_2: Setting Powered False 13:21:21.902927 run create_hlr_db(pid=25603): Terminated: ok {rc=0} 13:21:22.349987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25605): Launched 13:21:22.678235 run osmo-hlr_10.42.42.2(pid=25606): Launched 13:21:22.803925 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:23.338542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25608): Launched 13:21:23.647584 run osmo-stp_10.42.42.5(pid=25609): Launched 13:21:23.763030 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:24.313823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25611): Launched 13:21:24.618667 run osmo-msc_10.42.42.6(pid=25612): Launched 13:21:24.788777 run osmo-stp_10.42.42.5(pid=25609): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25609)] 13:21:24.917489 run osmo-stp_10.42.42.5(pid=25609): stdout: | (launched: 2022-12-13_13:21:23.590707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:25.046280 run osmo-stp_10.42.42.5(pid=25609): stderr: | 20221213132123761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132123761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132123761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132123762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132123762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132123763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132123763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:25.173210 run osmo-stp_10.42.42.5(pid=25609): stdout: | (launched: 2022-12-13_13:21:23.590707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:25.293612 run osmo-stp_10.42.42.5(pid=25609): stderr: | 20221213132123761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132123761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132123761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132123762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132123762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132123763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132123763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:25.437937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25609): Process ended prematurely: osmo-stp_10.42.42.5(pid=25609) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25609)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:21:25.446901 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:21:25.473170 run osmo-hlr_10.42.42.2(pid=25606): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25606)] 13:21:25.520757 run osmo-hlr_10.42.42.2(pid=25606): stdout: | (launched: 2022-12-13_13:21:22.617801) 13:21:25.570438 run osmo-hlr_10.42.42.2(pid=25606): stderr: | 20221213132122815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132122815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132122815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132122815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132122815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132122815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132122828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132122838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132122838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132122838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:25.639007 run osmo-msc_10.42.42.6(pid=25612): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25612)] 13:21:25.686464 run osmo-msc_10.42.42.6(pid=25612): stdout: | (launched: 2022-12-13_13:21:24.562170) 13:21:25.735352 run osmo-msc_10.42.42.6(pid=25612): stderr: | 20221213132124833 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132124833 DLGLOBAL DEBUG validating counter group 0x7f02be01dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132124833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132124833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132124833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132124833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132124835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132124835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132124836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132124836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:25.784566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25605): Terminating (SIGTERM) 13:21:25.824050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25608): Terminating (SIGTERM) 13:21:25.863486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25611): Terminating (SIGTERM) 13:21:25.903146 --- ParallelTerminationStrategy: PID 25605 died... 13:21:25.922182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25605): Terminated: ok {rc=0} 13:21:25.965777 --- ParallelTerminationStrategy: PID 25608 died... 13:21:25.984146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25608): Terminated: ok {rc=0} 13:21:26.028683 --- ParallelTerminationStrategy: PID 25611 died... 13:21:26.047363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25611): Terminated: ok {rc=0} 13:21:26.134668 bus /sierra_3: Setting Powered False 13:21:27.235530 bus /sierra_3: Setting Powered False 13:21:28.348347 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:21:29.498094 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:29.510481 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:21:29.583165 tst mo_mt_call_osmux.py: using LAC 34222 13:21:29.704120 tst mo_mt_call_osmux.py: using RAC 52 13:21:29.825884 tst mo_mt_call_osmux.py: using CellId 34222 13:21:29.948058 tst mo_mt_call_osmux.py: using BVCI 34223 13:21:30.060799 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:30.072014 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:30.082971 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:30.093964 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:30.105036 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:21:30.115895 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:21:30.237540 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:21:30.356733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:30.881657 run create_hlr_db(pid=25614): Launched 13:21:31.031247 bus /sierra_2: Setting Powered False 13:21:32.090717 run create_hlr_db(pid=25614): Terminated: ok {rc=0} 13:21:32.523586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25616): Launched 13:21:32.853632 run osmo-hlr_10.42.42.2(pid=25617): Launched 13:21:32.980878 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:33.548069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25619): Launched 13:21:33.878567 run osmo-stp_10.42.42.5(pid=25620): Launched 13:21:34.004619 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:34.596723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25622): Launched 13:21:34.926705 run osmo-msc_10.42.42.6(pid=25623): Launched 13:21:35.110975 run osmo-stp_10.42.42.5(pid=25620): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25620)] 13:21:35.250801 run osmo-stp_10.42.42.5(pid=25620): stdout: | (launched: 2022-12-13_13:21:33.818231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:35.391175 run osmo-stp_10.42.42.5(pid=25620): stderr: | 20221213132134007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132134007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132134007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132134008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132134008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132134008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132134008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:35.528862 run osmo-stp_10.42.42.5(pid=25620): stdout: | (launched: 2022-12-13_13:21:33.818231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:35.659557 run osmo-stp_10.42.42.5(pid=25620): stderr: | 20221213132134007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132134007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132134007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132134008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132134008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132134008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132134008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:35.816764 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25620): Process ended prematurely: osmo-stp_10.42.42.5(pid=25620) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25620)] [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:21:35.826816 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:21:35.854919 run osmo-hlr_10.42.42.2(pid=25617): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25617)] 13:21:35.906174 run osmo-hlr_10.42.42.2(pid=25617): stdout: | (launched: 2022-12-13_13:21:32.792893) 13:21:35.958970 run osmo-hlr_10.42.42.2(pid=25617): stderr: | 20221213132132990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132132990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132132990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132132990 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132132990 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132132990 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132133002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132133012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132133012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132133012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:36.032050 run osmo-msc_10.42.42.6(pid=25623): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25623)] 13:21:36.082334 run osmo-msc_10.42.42.6(pid=25623): stdout: | (launched: 2022-12-13_13:21:34.865752) 13:21:36.134912 run osmo-msc_10.42.42.6(pid=25623): stderr: | 20221213132135185 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132135185 DLGLOBAL DEBUG validating counter group 0x7f0672948c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132135185 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132135185 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132135186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132135186 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132135187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132135188 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132135188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132135188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:36.187660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25616): Terminating (SIGTERM) 13:21:36.229914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25619): Terminating (SIGTERM) 13:21:36.273070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25622): Terminating (SIGTERM) 13:21:36.315984 --- ParallelTerminationStrategy: PID 25616 died... 13:21:36.336799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25616): Terminated: ok {rc=0} 13:21:36.383815 --- ParallelTerminationStrategy: PID 25619 died... 13:21:36.403952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25619): Terminated: ok {rc=0} 13:21:36.451077 --- ParallelTerminationStrategy: PID 25622 died... 13:21:36.471192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25622): Terminated: ok {rc=0} 13:21:36.560902 bus /sierra_3: Setting Powered False 13:21:37.660033 bus /sierra_3: Setting Powered False 13:21:38.778567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:21:40.032111 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:40.039328 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:21:40.073614 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:21:40.101980 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:21:40.158275 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:21:40.190989 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:21:40.217706 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:21:40.772395 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:21:40.820937 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:40.832122 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:21:40.901101 tst mo_mt_call.py: using LAC 34223 13:21:41.021212 tst mo_mt_call.py: using RAC 53 13:21:41.142356 tst mo_mt_call.py: using CellId 34223 13:21:41.269291 tst mo_mt_call.py: using BVCI 34224 13:21:41.381280 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:41.392426 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:41.403401 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:41.414349 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:41.425376 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:41.436188 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:41.553767 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:41.675937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:42.185336 run create_hlr_db(pid=25628): Launched 13:21:42.311971 bus /sierra_2: Setting Powered False 13:21:43.376467 run create_hlr_db(pid=25628): Terminated: ok {rc=0} 13:21:43.834290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25630): Launched 13:21:44.162478 run osmo-hlr_10.42.42.2(pid=25631): Launched 13:21:44.289035 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:44.852052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25633): Launched 13:21:45.180321 run osmo-stp_10.42.42.5(pid=25634): Launched 13:21:45.305528 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:45.921710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25636): Launched 13:21:46.261873 run osmo-msc_10.42.42.6(pid=25637): Launched 13:21:46.566332 run osmo-stp_10.42.42.5(pid=25634): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25634)] 13:21:46.955647 run osmo-stp_10.42.42.5(pid=25634): stdout: | (launched: 2022-12-13_13:21:45.120027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:47.185314 run osmo-stp_10.42.42.5(pid=25634): stderr: | 20221213132145309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132145309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132145310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132145310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132145311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132145311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132145311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:47.325673 run osmo-stp_10.42.42.5(pid=25634): stdout: | (launched: 2022-12-13_13:21:45.120027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:47.456533 run osmo-stp_10.42.42.5(pid=25634): stderr: | 20221213132145309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132145309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132145310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132145310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132145311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132145311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132145311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:47.613074 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25634): Process ended prematurely: osmo-stp_10.42.42.5(pid=25634) [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25634)] [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:21:47.622944 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 13:21:47.651040 run osmo-hlr_10.42.42.2(pid=25631): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25631)] 13:21:47.702811 run osmo-hlr_10.42.42.2(pid=25631): stdout: | (launched: 2022-12-13_13:21:44.102105) 13:21:47.755539 run osmo-hlr_10.42.42.2(pid=25631): stderr: | 20221213132144299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132144299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132144299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132144299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132144299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132144299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132144311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132144320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132144320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132144320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:47.828490 run osmo-msc_10.42.42.6(pid=25637): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25637)] 13:21:47.878672 run osmo-msc_10.42.42.6(pid=25637): stdout: | (launched: 2022-12-13_13:21:46.198112) 13:21:47.930885 run osmo-msc_10.42.42.6(pid=25637): stderr: | 20221213132146856 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132146856 DLGLOBAL DEBUG validating counter group 0x7f772b13ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132146856 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132146857 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132146857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132146857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132146859 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132146860 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132146860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132146860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:47.983414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25630): Terminating (SIGTERM) 13:21:48.025613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25633): Terminating (SIGTERM) 13:21:48.068022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25636): Terminating (SIGTERM) 13:21:48.110870 --- ParallelTerminationStrategy: PID 25630 died... 13:21:48.131077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25630): Terminated: ok {rc=0} 13:21:48.177649 --- ParallelTerminationStrategy: PID 25633 died... 13:21:48.197728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25633): Terminated: ok {rc=0} 13:21:48.244266 --- ParallelTerminationStrategy: PID 25636 died... 13:21:48.264419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25636): Terminated: ok {rc=0} 13:21:48.353479 bus /sierra_3: Setting Powered False 13:21:49.452532 bus /sierra_3: Setting Powered False 13:21:50.567843 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:21:51.714246 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:51.726078 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:21:51.796296 tst mo_mt_call_osmux.py: using LAC 34224 13:21:51.916366 tst mo_mt_call_osmux.py: using RAC 54 13:21:52.035438 tst mo_mt_call_osmux.py: using CellId 34224 13:21:52.156581 tst mo_mt_call_osmux.py: using BVCI 34225 13:21:52.269288 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:52.280385 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:52.291394 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:52.302369 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:52.313398 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:21:52.324392 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:52.440786 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:52.562794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:53.072918 run create_hlr_db(pid=25639): Launched 13:21:53.200429 bus /sierra_2: Setting Powered False 13:21:54.265672 run create_hlr_db(pid=25639): Terminated: ok {rc=0} 13:21:54.703680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Launched 13:21:55.011048 run osmo-hlr_10.42.42.2(pid=25642): Launched 13:21:55.126455 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:55.651356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Launched 13:21:55.957417 run osmo-stp_10.42.42.5(pid=25645): Launched 13:21:56.074099 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:56.630396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25647): Launched 13:21:56.936899 run osmo-msc_10.42.42.6(pid=25648): Launched 13:21:57.107848 run osmo-stp_10.42.42.5(pid=25645): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] 13:21:57.235936 run osmo-stp_10.42.42.5(pid=25645): stdout: | (launched: 2022-12-13_13:21:55.900490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:57.365085 run osmo-stp_10.42.42.5(pid=25645): stderr: | 20221213132156069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132156069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132156069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132156069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132156070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132156070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132156070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:57.491977 run osmo-stp_10.42.42.5(pid=25645): stdout: | (launched: 2022-12-13_13:21:55.900490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:57.612013 run osmo-stp_10.42.42.5(pid=25645): stderr: | 20221213132156069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132156069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132156069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132156069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132156070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132156070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132156070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:57.756250 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25645): Process ended prematurely: osmo-stp_10.42.42.5(pid=25645) [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:21:57.765303 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:21:57.791542 run osmo-hlr_10.42.42.2(pid=25642): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25642)] 13:21:57.840382 run osmo-hlr_10.42.42.2(pid=25642): stdout: | (launched: 2022-12-13_13:21:54.954163) 13:21:57.889996 run osmo-hlr_10.42.42.2(pid=25642): stderr: | 20221213132155128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132155128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132155128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132155128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132155128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132155128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132155142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132155151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132155152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132155152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:57.959292 run osmo-msc_10.42.42.6(pid=25648): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25648)] 13:21:58.007191 run osmo-msc_10.42.42.6(pid=25648): stdout: | (launched: 2022-12-13_13:21:56.879715) 13:21:58.057214 run osmo-msc_10.42.42.6(pid=25648): stderr: | 20221213132157149 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132157149 DLGLOBAL DEBUG validating counter group 0x7ff7f53e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132157149 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132157149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132157149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132157150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132157151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132157152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132157152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132157152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:58.107041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Terminating (SIGTERM) 13:21:58.146708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Terminating (SIGTERM) 13:21:58.186621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25647): Terminating (SIGTERM) 13:21:58.226674 --- ParallelTerminationStrategy: PID 25641 died... 13:21:58.245798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25641): Terminated: ok {rc=0} 13:21:58.289398 --- ParallelTerminationStrategy: PID 25644 died... 13:21:58.307816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25644): Terminated: ok {rc=0} 13:21:58.351617 --- ParallelTerminationStrategy: PID 25647 died... 13:21:58.370150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25647): Terminated: ok {rc=0} 13:21:58.455793 bus /sierra_3: Setting Powered False 13:21:59.554090 bus /sierra_3: Setting Powered False 13:22:00.667669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:22:01.972837 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:01.982444 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:22:02.041856 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:22:02.070796 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:22:02.133152 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:22:02.174911 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:22:02.202140 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:22:02.737654 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:22:02.787273 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:02.798184 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:22:02.869718 tst mo_mt_call.py: using LAC 34225 13:22:02.992584 tst mo_mt_call.py: using RAC 55 13:22:03.114786 tst mo_mt_call.py: using CellId 34225 13:22:03.237248 tst mo_mt_call.py: using BVCI 34226 13:22:03.348332 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:03.359352 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:03.370061 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:03.380682 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:03.392044 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:03.403309 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:22:03.524698 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:22:03.644130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:04.122658 run create_hlr_db(pid=25653): Launched 13:22:04.249925 bus /sierra_2: Setting Powered False 13:22:05.310776 run create_hlr_db(pid=25653): Terminated: ok {rc=0} 13:22:05.759714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Launched 13:22:06.091781 run osmo-hlr_10.42.42.2(pid=25656): Launched 13:22:06.217907 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:06.782929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Launched 13:22:07.094769 run osmo-stp_10.42.42.5(pid=25659): Launched 13:22:07.210945 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:07.764388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25661): Launched 13:22:08.072112 run osmo-msc_10.42.42.6(pid=25662): Launched 13:22:08.242720 run osmo-stp_10.42.42.5(pid=25659): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] 13:22:08.371552 run osmo-stp_10.42.42.5(pid=25659): stdout: | (launched: 2022-12-13_13:22:07.037737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:08.500660 run osmo-stp_10.42.42.5(pid=25659): stderr: | 20221213132207206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132207206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132207206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132207206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132207207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132207207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132207207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:08.627696 run osmo-stp_10.42.42.5(pid=25659): stdout: | (launched: 2022-12-13_13:22:07.037737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:08.748087 run osmo-stp_10.42.42.5(pid=25659): stderr: | 20221213132207206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132207206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132207206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132207206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132207207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132207207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132207207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:08.893310 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25659): Process ended prematurely: osmo-stp_10.42.42.5(pid=25659) [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:22:08.902276 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:22:08.928835 run osmo-hlr_10.42.42.2(pid=25656): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25656)] 13:22:08.976921 run osmo-hlr_10.42.42.2(pid=25656): stdout: | (launched: 2022-12-13_13:22:06.030316) 13:22:09.026653 run osmo-hlr_10.42.42.2(pid=25656): stderr: | 20221213132206226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132206226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132206226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132206226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132206226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132206226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132206238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132206247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132206247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132206247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:09.096026 run osmo-msc_10.42.42.6(pid=25662): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25662)] 13:22:09.144141 run osmo-msc_10.42.42.6(pid=25662): stdout: | (launched: 2022-12-13_13:22:08.015067) 13:22:09.194237 run osmo-msc_10.42.42.6(pid=25662): stderr: | 20221213132208287 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132208287 DLGLOBAL DEBUG validating counter group 0x7f102caffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132208287 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132208287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132208287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132208287 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132208289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132208290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132208291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132208291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:09.244163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Terminating (SIGTERM) 13:22:09.284364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Terminating (SIGTERM) 13:22:09.324426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25661): Terminating (SIGTERM) 13:22:09.364718 --- ParallelTerminationStrategy: PID 25655 died... 13:22:09.384104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25655): Terminated: ok {rc=0} 13:22:09.428540 --- ParallelTerminationStrategy: PID 25658 died... 13:22:09.447343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25658): Terminated: ok {rc=0} 13:22:09.491450 --- ParallelTerminationStrategy: PID 25661 died... 13:22:09.510169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25661): Terminated: ok {rc=0} 13:22:09.597235 bus /sierra_3: Setting Powered False 13:22:10.699304 bus /sierra_3: Setting Powered False 13:22:11.814617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:22:12.965988 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:12.978332 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:22:13.052682 tst mo_mt_call_osmux.py: using LAC 34226 13:22:13.183437 tst mo_mt_call_osmux.py: using RAC 56 13:22:13.306504 tst mo_mt_call_osmux.py: using CellId 34226 13:22:13.428521 tst mo_mt_call_osmux.py: using BVCI 34227 13:22:13.541628 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:13.552591 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:13.563450 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:13.574242 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:13.585557 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:22:13.596854 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:22:13.718797 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:22:13.837297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:14.314278 run create_hlr_db(pid=25664): Launched 13:22:14.441870 bus /sierra_2: Setting Powered False 13:22:15.506739 run create_hlr_db(pid=25664): Terminated: ok {rc=0} 13:22:15.987626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25666): Launched 13:22:16.333559 run osmo-hlr_10.42.42.2(pid=25667): Launched 13:22:16.579382 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:17.227091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25669): Launched 13:22:17.557737 run osmo-stp_10.42.42.5(pid=25670): Launched 13:22:17.683706 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:18.278175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25672): Launched 13:22:18.607944 run osmo-msc_10.42.42.6(pid=25673): Launched 13:22:18.792455 run osmo-stp_10.42.42.5(pid=25670): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25670)] 13:22:18.930424 run osmo-stp_10.42.42.5(pid=25670): stdout: | (launched: 2022-12-13_13:22:17.497376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:19.069675 run osmo-stp_10.42.42.5(pid=25670): stderr: | 20221213132217689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132217689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132217689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132217690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132217691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132217691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132217691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:19.207040 run osmo-stp_10.42.42.5(pid=25670): stdout: | (launched: 2022-12-13_13:22:17.497376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:19.337272 run osmo-stp_10.42.42.5(pid=25670): stderr: | 20221213132217689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132217689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132217689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132217690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132217691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132217691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132217691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:19.492850 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25670): Process ended prematurely: osmo-stp_10.42.42.5(pid=25670) [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25670)] [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:22:19.502721 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:22:19.530851 run osmo-hlr_10.42.42.2(pid=25667): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25667)] 13:22:19.582015 run osmo-hlr_10.42.42.2(pid=25667): stdout: | (launched: 2022-12-13_13:22:16.272733) 13:22:19.634436 run osmo-hlr_10.42.42.2(pid=25667): stderr: | 20221213132216567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132216567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132216567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132216567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132216567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132216567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132216585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132216599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132216599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132216600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:19.707349 run osmo-msc_10.42.42.6(pid=25673): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25673)] 13:22:19.757440 run osmo-msc_10.42.42.6(pid=25673): stdout: | (launched: 2022-12-13_13:22:18.547526) 13:22:19.809415 run osmo-msc_10.42.42.6(pid=25673): stderr: | 20221213132218868 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132218868 DLGLOBAL DEBUG validating counter group 0x7f635bf7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132218868 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132218868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132218868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132218868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132218870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132218870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132218871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132218871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:19.862349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25666): Terminating (SIGTERM) 13:22:19.904323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25669): Terminating (SIGTERM) 13:22:19.946737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25672): Terminating (SIGTERM) 13:22:19.989511 --- ParallelTerminationStrategy: PID 25666 died... 13:22:20.010191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25666): Terminated: ok {rc=0} 13:22:20.057101 --- ParallelTerminationStrategy: PID 25669 died... 13:22:20.077287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25669): Terminated: ok {rc=0} 13:22:20.124071 --- ParallelTerminationStrategy: PID 25672 died... 13:22:20.144198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25672): Terminated: ok {rc=0} 13:22:20.233026 bus /sierra_3: Setting Powered False 13:22:21.333170 bus /sierra_3: Setting Powered False 13:22:22.450576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 13:22:23.708320 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:23.713828 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 13:22:23.747554 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 13:22:23.775682 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 13:22:23.828647 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 13:22:23.862926 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 13:22:23.890609 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 13:22:24.440596 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 13:22:24.494610 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:24.506180 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:22:24.558536 tst mo_mt_call.py: using LAC 34227 13:22:24.687238 tst mo_mt_call.py: using RAC 57 13:22:24.816093 tst mo_mt_call.py: using CellId 34227 13:22:24.946483 tst mo_mt_call.py: using BVCI 34228 13:22:25.066232 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:25.077920 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:25.089399 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:25.100727 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:25.112250 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:25.123886 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:22:25.242371 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:22:25.358861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:25.833950 run create_hlr_db(pid=25678): Launched 13:22:25.962214 bus /sierra_2: Setting Powered False 13:22:27.023495 run create_hlr_db(pid=25678): Terminated: ok {rc=0} 13:22:27.470998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Launched 13:22:27.801426 run osmo-hlr_10.42.42.2(pid=25681): Launched 13:22:27.928748 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:28.496543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Launched 13:22:28.825541 run osmo-stp_10.42.42.5(pid=25684): Launched 13:22:28.952541 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:29.547270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Launched 13:22:29.877709 run osmo-msc_10.42.42.6(pid=25687): Launched 13:22:30.061337 run osmo-stp_10.42.42.5(pid=25684): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] 13:22:30.199359 run osmo-stp_10.42.42.5(pid=25684): stdout: | (launched: 2022-12-13_13:22:28.765023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:30.338812 run osmo-stp_10.42.42.5(pid=25684): stderr: | 20221213132228955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132228955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132228955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132228956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132228956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132228957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132228957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:30.475849 run osmo-stp_10.42.42.5(pid=25684): stdout: | (launched: 2022-12-13_13:22:28.765023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:30.605444 run osmo-stp_10.42.42.5(pid=25684): stderr: | 20221213132228955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132228955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132228955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132228956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132228956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132228957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132228957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:30.761599 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25684): Process ended prematurely: osmo-stp_10.42.42.5(pid=25684) [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 13:22:30.771408 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:22:30.799367 run osmo-hlr_10.42.42.2(pid=25681): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25681)] 13:22:30.851580 run osmo-hlr_10.42.42.2(pid=25681): stdout: | (launched: 2022-12-13_13:22:27.741023) 13:22:30.911273 run osmo-hlr_10.42.42.2(pid=25681): stderr: | 20221213132227939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132227939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132227939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132227939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132227939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132227939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132227952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132227962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132227963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132227963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:30.986007 run osmo-msc_10.42.42.6(pid=25687): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25687)] 13:22:31.037291 run osmo-msc_10.42.42.6(pid=25687): stdout: | (launched: 2022-12-13_13:22:29.817413) 13:22:31.091593 run osmo-msc_10.42.42.6(pid=25687): stderr: | 20221213132230140 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132230140 DLGLOBAL DEBUG validating counter group 0x7fa490cd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132230140 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132230140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132230140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132230140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132230142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132230143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132230143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132230143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:31.146457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Terminating (SIGTERM) 13:22:31.189662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Terminating (SIGTERM) 13:22:31.234489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Terminating (SIGTERM) 13:22:31.280542 --- ParallelTerminationStrategy: PID 25680 died... 13:22:31.302879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Terminated: ok {rc=0} 13:22:31.351733 --- ParallelTerminationStrategy: PID 25683 died... 13:22:31.373630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Terminated: ok {rc=0} 13:22:31.422648 --- ParallelTerminationStrategy: PID 25686 died... 13:22:31.444386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Terminated: ok {rc=0} 13:22:31.536554 bus /sierra_3: Setting Powered False 13:22:32.637452 bus /sierra_3: Setting Powered False 13:22:33.754947 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 13:22:34.904198 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:34.916339 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:22:34.969626 tst mo_mt_call_osmux.py: using LAC 34228 13:22:35.104425 tst mo_mt_call_osmux.py: using RAC 58 13:22:35.233097 tst mo_mt_call_osmux.py: using CellId 34228 13:22:35.359875 tst mo_mt_call_osmux.py: using BVCI 34229 13:22:35.479097 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:35.490694 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:35.502458 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:35.513991 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:35.525817 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:22:35.537460 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:22:35.656195 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:22:35.778974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:36.287929 run create_hlr_db(pid=25689): Launched 13:22:36.414393 bus /sierra_2: Setting Powered False 13:22:37.478878 run create_hlr_db(pid=25689): Terminated: ok {rc=0} 13:22:37.916806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Launched 13:22:38.224679 run osmo-hlr_10.42.42.2(pid=25692): Launched 13:22:38.342380 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:38.881723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Launched 13:22:39.191911 run osmo-stp_10.42.42.5(pid=25695): Launched 13:22:39.307979 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:39.873687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Launched 13:22:40.182723 run osmo-msc_10.42.42.6(pid=25698): Launched 13:22:40.356470 run osmo-stp_10.42.42.5(pid=25695): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] 13:22:40.485544 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-13_13:22:39.134591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:40.614773 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221213132239305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132239305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132239305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132239306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132239306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132239306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132239306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:40.741756 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-13_13:22:39.134591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:40.862606 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221213132239305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132239305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132239305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132239306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132239306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132239306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132239306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:41.007551 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 13:22:41.016440 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:22:41.042882 run osmo-hlr_10.42.42.2(pid=25692): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25692)] 13:22:41.090668 run osmo-hlr_10.42.42.2(pid=25692): stdout: | (launched: 2022-12-13_13:22:38.167696) 13:22:41.140205 run osmo-hlr_10.42.42.2(pid=25692): stderr: | 20221213132238342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132238342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132238342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132238342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132238342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132238342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132238355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132238363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132238363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132238363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:41.209117 run osmo-msc_10.42.42.6(pid=25698): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25698)] 13:22:41.256798 run osmo-msc_10.42.42.6(pid=25698): stdout: | (launched: 2022-12-13_13:22:40.124625) 13:22:41.306096 run osmo-msc_10.42.42.6(pid=25698): stderr: | 20221213132240395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132240395 DLGLOBAL DEBUG validating counter group 0x7f1d0d5ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132240395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132240395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132240396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132240396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132240398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132240398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132240398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132240398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:41.355786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminating (SIGTERM) 13:22:41.395349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminating (SIGTERM) 13:22:41.435025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminating (SIGTERM) 13:22:41.474969 --- ParallelTerminationStrategy: PID 25691 died... 13:22:41.494101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminated: ok {rc=0} 13:22:41.538195 --- ParallelTerminationStrategy: PID 25694 died... 13:22:41.556751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminated: ok {rc=0} 13:22:41.600340 --- ParallelTerminationStrategy: PID 25697 died... 13:22:41.618967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminated: ok {rc=0} 13:22:41.702664 bus /sierra_3: Setting Powered False 13:22:42.801017 bus /sierra_3: Setting Powered False 13:22:43.917820 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:22:45.172277 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:45.179130 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:22:45.214404 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:22:45.242169 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:22:45.295467 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:22:45.329525 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:22:45.357326 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:22:45.916213 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:22:45.967797 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:45.979972 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:22:46.035027 tst mo_mt_call.py: using LAC 34229 13:22:46.204309 tst mo_mt_call.py: using RAC 59 13:22:46.343368 tst mo_mt_call.py: using CellId 34229 13:22:46.513451 tst mo_mt_call.py: using BVCI 34230 13:22:46.631302 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:46.643072 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:46.655160 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:46.667907 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:46.681813 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:46.695341 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:22:46.838972 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:22:46.999748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:47.549660 run create_hlr_db(pid=25704): Launched 13:22:47.678934 bus /sierra_2: Setting Powered False 13:22:48.744225 run create_hlr_db(pid=25704): Terminated: ok {rc=0} 13:22:49.200745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Launched 13:22:49.529341 run osmo-hlr_10.42.42.2(pid=25707): Launched 13:22:49.655230 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:50.220545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Launched 13:22:50.551287 run osmo-stp_10.42.42.5(pid=25710): Launched 13:22:50.677594 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:51.269927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Launched 13:22:51.600628 run osmo-msc_10.42.42.6(pid=25713): Launched 13:22:51.785442 run osmo-stp_10.42.42.5(pid=25710): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] 13:22:51.950249 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-13_13:22:50.490721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:52.087763 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221213132250681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132250681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132250681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132250682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132250682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132250682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132250682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:52.225057 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-13_13:22:50.490721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:52.355782 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221213132250681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132250681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132250681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132250682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132250682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132250682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132250682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:52.512297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:22:52.522192 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:22:52.549906 run osmo-hlr_10.42.42.2(pid=25707): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25707)] 13:22:52.600546 run osmo-hlr_10.42.42.2(pid=25707): stdout: | (launched: 2022-12-13_13:22:49.468462) 13:22:52.652445 run osmo-hlr_10.42.42.2(pid=25707): stderr: | 20221213132249665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132249665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132249665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132249665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132249665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132249665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132249682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132249693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132249693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132249693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:52.725179 run osmo-msc_10.42.42.6(pid=25713): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25713)] 13:22:52.775115 run osmo-msc_10.42.42.6(pid=25713): stdout: | (launched: 2022-12-13_13:22:51.539912) 13:22:52.826765 run osmo-msc_10.42.42.6(pid=25713): stderr: | 20221213132251861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132251861 DLGLOBAL DEBUG validating counter group 0x7f37270ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132251861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132251861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132251861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132251861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132251863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132251863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132251864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132251864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:52.878818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminating (SIGTERM) 13:22:52.921026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminating (SIGTERM) 13:22:52.963482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Terminating (SIGTERM) 13:22:53.005812 --- ParallelTerminationStrategy: PID 25706 died... 13:22:53.026340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminated: ok {rc=0} 13:22:53.073032 --- ParallelTerminationStrategy: PID 25709 died... 13:22:53.092642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminated: ok {rc=0} 13:22:53.139108 --- ParallelTerminationStrategy: PID 25712 died... 13:22:53.158932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Terminated: ok {rc=0} 13:22:53.247310 bus /sierra_3: Setting Powered False 13:22:54.347144 bus /sierra_3: Setting Powered False 13:22:55.463933 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:22:56.607593 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:56.619605 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:22:56.672605 tst mo_mt_call_osmux.py: using LAC 34230 13:22:56.795744 tst mo_mt_call_osmux.py: using RAC 60 13:22:56.917328 tst mo_mt_call_osmux.py: using CellId 34230 13:22:57.037780 tst mo_mt_call_osmux.py: using BVCI 34231 13:22:57.151074 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:57.162478 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:57.173927 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:57.185252 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:57.196501 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:22:57.207680 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:22:57.323873 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:22:57.450001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:57.959915 run create_hlr_db(pid=25715): Launched 13:22:58.088029 bus /sierra_2: Setting Powered False 13:22:59.153202 run create_hlr_db(pid=25715): Terminated: ok {rc=0} 13:22:59.591954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25717): Launched 13:22:59.898870 run osmo-hlr_10.42.42.2(pid=25718): Launched 13:23:00.017567 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:00.546522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25720): Launched 13:23:00.861679 run osmo-stp_10.42.42.5(pid=25721): Launched 13:23:01.147193 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:01.820079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Launched 13:23:02.147796 run osmo-msc_10.42.42.6(pid=25729): Launched 13:23:02.435162 run osmo-stp_10.42.42.5(pid=25721): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25721)] 13:23:02.573270 run osmo-stp_10.42.42.5(pid=25721): stdout: | (launched: 2022-12-13_13:23:00.795734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:02.714636 run osmo-stp_10.42.42.5(pid=25721): stderr: | 20221213132301100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132301101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132301102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132301103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132301104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132301105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132301105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:02.852002 run osmo-stp_10.42.42.5(pid=25721): stdout: | (launched: 2022-12-13_13:23:00.795734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:02.982710 run osmo-stp_10.42.42.5(pid=25721): stderr: | 20221213132301100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132301101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132301102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132301103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132301104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132301105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132301105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:03.138361 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25721): Process ended prematurely: osmo-stp_10.42.42.5(pid=25721) [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25721)] [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:23:03.148063 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:23:03.176022 run osmo-hlr_10.42.42.2(pid=25718): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25718)] 13:23:03.226960 run osmo-hlr_10.42.42.2(pid=25718): stdout: | (launched: 2022-12-13_13:22:59.841385) 13:23:03.279431 run osmo-hlr_10.42.42.2(pid=25718): stderr: | 20221213132300018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132300018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132300018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132300018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132300018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132300018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132300031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132300041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132300042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132300042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:03.352348 run osmo-msc_10.42.42.6(pid=25729): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25729)] 13:23:03.402456 run osmo-msc_10.42.42.6(pid=25729): stdout: | (launched: 2022-12-13_13:23:02.088787) 13:23:03.455340 run osmo-msc_10.42.42.6(pid=25729): stderr: | 20221213132302452 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132302452 DLGLOBAL DEBUG validating counter group 0x7f2bdf5cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132302452 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132302452 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132302453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132302453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132302454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132302455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132302455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132302455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:03.507911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25717): Terminating (SIGTERM) 13:23:03.549817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25720): Terminating (SIGTERM) 13:23:03.592864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminating (SIGTERM) 13:23:03.635374 --- ParallelTerminationStrategy: PID 25717 died... 13:23:03.655854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25717): Terminated: ok {rc=0} 13:23:03.703040 --- ParallelTerminationStrategy: PID 25720 died... 13:23:03.723210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25720): Terminated: ok {rc=0} 13:23:03.769581 --- ParallelTerminationStrategy: PID 25728 died... 13:23:03.789420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25728): Terminated: ok {rc=0} 13:23:03.877304 bus /sierra_3: Setting Powered False 13:23:04.975311 bus /sierra_3: Setting Powered False 13:23:06.094051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:trx-b200 --------------------------------------------------------------------- 13:23:07.346199 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:07.350970 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 13:23:07.384809 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:23:07.413426 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 13:23:07.501376 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 13:23:07.535475 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:23:07.563134 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 13:23:08.147900 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 13:23:08.153569 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.164630 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:23:08.215774 tst emergency_mo_mt_call.py: using LAC 34231 13:23:08.343906 tst emergency_mo_mt_call.py: using RAC 61 13:23:08.473275 tst emergency_mo_mt_call.py: using CellId 34231 13:23:08.598922 tst emergency_mo_mt_call.py: using BVCI 34232 13:23:08.716144 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.727821 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.738890 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.749946 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.761157 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:08.772543 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:08.891784 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:09.012206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:09.510864 run create_hlr_db(pid=25734): Launched 13:23:09.635370 bus /sierra_2: Setting Powered False 13:23:10.699116 run create_hlr_db(pid=25734): Terminated: ok {rc=0} 13:23:11.131858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25736): Launched 13:23:11.433102 run osmo-hlr_10.42.42.2(pid=25737): Launched 13:23:11.546931 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:12.064731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25739): Launched 13:23:12.365990 run osmo-stp_10.42.42.5(pid=25740): Launched 13:23:12.490356 tst emergency_mo_mt_call.py: using MSISDN 8179 13:23:12.643932 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:13.185758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25742): Launched 13:23:13.486046 run osmo-msc_10.42.42.6(pid=25743): Launched 13:23:13.652648 run osmo-stp_10.42.42.5(pid=25740): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25740)] 13:23:13.778199 run osmo-stp_10.42.42.5(pid=25740): stdout: | (launched: 2022-12-13_13:23:12.309515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:13.904634 run osmo-stp_10.42.42.5(pid=25740): stderr: | 20221213132312477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132312478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132312478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132312478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132312479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132312479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132312479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:14.029332 run osmo-stp_10.42.42.5(pid=25740): stdout: | (launched: 2022-12-13_13:23:12.309515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:14.149381 run osmo-stp_10.42.42.5(pid=25740): stderr: | 20221213132312477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132312478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132312478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132312478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132312479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132312479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132312479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:14.291193 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25740): Process ended prematurely: osmo-stp_10.42.42.5(pid=25740) [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25740)] [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 13:23:14.299545 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 13:23:14.325375 run osmo-hlr_10.42.42.2(pid=25737): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25737)] 13:23:14.373479 run osmo-hlr_10.42.42.2(pid=25737): stdout: | (launched: 2022-12-13_13:23:11.377344) 13:23:14.423074 run osmo-hlr_10.42.42.2(pid=25737): stderr: | 20221213132311551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132311551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132311551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132311551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132311551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132311551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132311563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132311571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132311572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132311572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:14.492614 run osmo-msc_10.42.42.6(pid=25743): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25743)] 13:23:14.539999 run osmo-msc_10.42.42.6(pid=25743): stdout: | (launched: 2022-12-13_13:23:13.430092) 13:23:14.589127 run osmo-msc_10.42.42.6(pid=25743): stderr: | 20221213132313703 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132313703 DLGLOBAL DEBUG validating counter group 0x7f4d500bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132313703 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132313703 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132313704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132313704 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132313706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132313706 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132313706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132313706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:14.638258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25736): Terminating (SIGTERM) 13:23:14.677725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25739): Terminating (SIGTERM) 13:23:14.717262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25742): Terminating (SIGTERM) 13:23:14.757213 --- ParallelTerminationStrategy: PID 25736 died... 13:23:14.775927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25736): Terminated: ok {rc=0} 13:23:14.819622 --- ParallelTerminationStrategy: PID 25739 died... 13:23:14.838209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25739): Terminated: ok {rc=0} 13:23:14.881570 --- ParallelTerminationStrategy: PID 25742 died... 13:23:14.899877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25742): Terminated: ok {rc=0} 13:23:14.985077 bus /sierra_3: Setting Powered False 13:23:16.094086 bus /sierra_3: Setting Powered False 13:23:17.235702 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 13:23:18.322579 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.334783 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:23:18.387226 tst emergency_preemptive_call.py: using LAC 34232 13:23:18.507871 tst emergency_preemptive_call.py: using RAC 62 13:23:18.627657 tst emergency_preemptive_call.py: using CellId 34232 13:23:18.746746 tst emergency_preemptive_call.py: using BVCI 34233 13:23:18.856938 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.867828 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.878454 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.888909 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.899471 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:23:18.910043 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:19.031302 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:19.153104 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:19.274089 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:23:19.394086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:19.893672 run create_hlr_db(pid=25745): Launched 13:23:20.018901 bus /sierra_2: Setting Powered False 13:23:21.082394 run create_hlr_db(pid=25745): Terminated: ok {rc=0} 13:23:21.514697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Launched 13:23:21.816261 run osmo-hlr_10.42.42.2(pid=25748): Launched 13:23:21.930577 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:22.462738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Launched 13:23:22.765939 run osmo-stp_10.42.42.5(pid=25751): Launched 13:23:22.891585 tst emergency_preemptive_call.py: using MSISDN 8180 13:23:23.045445 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:23.586333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Launched 13:23:23.887036 run osmo-msc_10.42.42.6(pid=25754): Launched 13:23:24.054180 run osmo-stp_10.42.42.5(pid=25751): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] 13:23:24.180419 run osmo-stp_10.42.42.5(pid=25751): stdout: | (launched: 2022-12-13_13:23:22.709958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:24.307292 run osmo-stp_10.42.42.5(pid=25751): stderr: | 20221213132322879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132322879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132322879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132322880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132322880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132322880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132322880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:24.432875 run osmo-stp_10.42.42.5(pid=25751): stdout: | (launched: 2022-12-13_13:23:22.709958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:24.552066 run osmo-stp_10.42.42.5(pid=25751): stderr: | 20221213132322879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132322879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132322879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132322880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132322880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132322880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132322880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:24.694119 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25751): Process ended prematurely: osmo-stp_10.42.42.5(pid=25751) [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py:32] 13:23:24.702549 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:23:24.728667 run osmo-hlr_10.42.42.2(pid=25748): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25748)] 13:23:24.777264 run osmo-hlr_10.42.42.2(pid=25748): stdout: | (launched: 2022-12-13_13:23:21.759962) 13:23:24.826636 run osmo-hlr_10.42.42.2(pid=25748): stderr: | 20221213132321935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132321935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132321935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132321936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132321936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132321936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132321948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132321957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132321957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132321958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:24.895751 run osmo-msc_10.42.42.6(pid=25754): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25754)] 13:23:24.943382 run osmo-msc_10.42.42.6(pid=25754): stdout: | (launched: 2022-12-13_13:23:23.831262) 13:23:24.992449 run osmo-msc_10.42.42.6(pid=25754): stderr: | 20221213132324101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132324101 DLGLOBAL DEBUG validating counter group 0x7faa2e542c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132324101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132324101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132324101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132324101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132324103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132324104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132324104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132324104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:25.041692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Terminating (SIGTERM) 13:23:25.081394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Terminating (SIGTERM) 13:23:25.121055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Terminating (SIGTERM) 13:23:25.160888 --- ParallelTerminationStrategy: PID 25747 died... 13:23:25.179636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25747): Terminated: ok {rc=0} 13:23:25.223661 --- ParallelTerminationStrategy: PID 25750 died... 13:23:25.242327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25750): Terminated: ok {rc=0} 13:23:25.286229 --- ParallelTerminationStrategy: PID 25753 died... 13:23:25.304903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25753): Terminated: ok {rc=0} 13:23:25.391156 bus /sierra_9: Setting Powered False 13:23:26.491352 bus /sierra_9: Setting Powered False 13:23:27.609218 bus /sierra_8: Setting Powered False 13:23:28.709298 bus /sierra_8: Setting Powered False 13:23:29.825684 bus /sierra_3: Setting Powered False 13:23:30.924106 bus /sierra_3: Setting Powered False 13:23:32.043617 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-b200 --------------------------------------------------------------------- 13:23:33.324344 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:33.328660 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 13:23:33.361353 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 13:23:33.399693 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 13:23:33.486020 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 13:23:33.518686 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 13:23:33.556723 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 13:23:34.147058 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 13:23:34.196899 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.207524 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:23:34.255722 tst cs_paging_gprs_active.py: using LAC 34233 13:23:34.378926 tst cs_paging_gprs_active.py: using RAC 63 13:23:34.500640 tst cs_paging_gprs_active.py: using CellId 34233 13:23:34.621748 tst cs_paging_gprs_active.py: using BVCI 34234 13:23:34.733595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.744254 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.755011 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.765602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.775993 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.786450 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.797498 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.808108 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:34.818790 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:34.935767 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:35.058113 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:23:35.280505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:35.611318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25759): Launched 13:23:35.898881 run iperf3-srv_10.42.42.10(pid=25760): Launched 13:23:36.024139 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:23:36.246563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:36.578269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25761): Launched 13:23:36.867226 run iperf3-srv_10.42.42.10(pid=25762): Launched 13:23:36.991590 tst cs_paging_gprs_active.py:38: start network... 13:23:37.213445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:37.725972 run create_hlr_db(pid=25763): Launched 13:23:37.855567 bus /sierra_2: Setting Powered False 13:23:38.920223 run create_hlr_db(pid=25763): Terminated: ok {rc=0} 13:23:39.360533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25765): Launched 13:23:39.667844 run osmo-hlr_10.42.42.2(pid=25766): Launched 13:23:39.785861 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:40.355141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25768): Launched 13:23:40.686453 run osmo-stp_10.42.42.5(pid=25769): Launched 13:23:40.813939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:41.383019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25771): Launched 13:23:41.511267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:41.791399 run patchelf(pid=25772): Launched 13:23:41.976049 run osmo-stp_10.42.42.5(pid=25769): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25769)] 13:23:42.115946 run osmo-stp_10.42.42.5(pid=25769): stdout: | (launched: 2022-12-13_13:23:40.625687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:42.257183 run osmo-stp_10.42.42.5(pid=25769): stderr: | 20221213132340818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132340818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132340818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132340819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132340819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132340819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132340819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:42.398452 run osmo-stp_10.42.42.5(pid=25769): stdout: | (launched: 2022-12-13_13:23:40.625687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:42.533716 run osmo-stp_10.42.42.5(pid=25769): stderr: | 20221213132340818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132340818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132340818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132340819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132340819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132340819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132340819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:42.694251 run patchelf(pid=25772): Terminating (SIGINT) 13:23:42.879281 run patchelf(pid=25772): Terminated: ok {rc=0} 13:23:43.012459 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25769): Process ended prematurely: osmo-stp_10.42.42.5(pid=25769) [trial-2390↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25769)] [trial-2390↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 13:23:43.023051 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:23:43.051610 run osmo-hlr_10.42.42.2(pid=25766): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25766)] 13:23:43.102334 run osmo-hlr_10.42.42.2(pid=25766): stdout: | (launched: 2022-12-13_13:23:39.611158) 13:23:43.154884 run osmo-hlr_10.42.42.2(pid=25766): stderr: | 20221213132339787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132339787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132339787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132339787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132339787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132339787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132339799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132339807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132339808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132339808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:43.207700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25759): Terminating (SIGTERM) 13:23:43.249791 run iperf3-srv_10.42.42.10(pid=25760): Terminating (SIGTERM) 13:23:43.292624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25761): Terminating (SIGTERM) 13:23:43.335195 run iperf3-srv_10.42.42.10(pid=25762): Terminating (SIGTERM) 13:23:43.377814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25765): Terminating (SIGTERM) 13:23:43.420465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25768): Terminating (SIGTERM) 13:23:43.463247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25771): Terminating (SIGTERM) 13:23:43.506428 --- ParallelTerminationStrategy: PID 25759 died... 13:23:43.527070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25759): Terminated: ok {rc=0} 13:23:43.574387 --- ParallelTerminationStrategy: PID 25760 died... 13:23:43.594515 run iperf3-srv_10.42.42.10(pid=25760): Terminated {rc=256} 13:23:43.640909 --- ParallelTerminationStrategy: PID 25761 died... 13:23:43.661350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25761): Terminated: ok {rc=0} 13:23:43.707881 --- ParallelTerminationStrategy: PID 25762 died... 13:23:43.727942 run iperf3-srv_10.42.42.10(pid=25762): Terminated {rc=256} 13:23:43.775444 --- ParallelTerminationStrategy: PID 25765 died... 13:23:43.795736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25765): Terminated: ok {rc=0} 13:23:43.842295 --- ParallelTerminationStrategy: PID 25768 died... 13:23:43.862302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25768): Terminated: ok {rc=0} 13:23:43.909015 --- ParallelTerminationStrategy: PID 25771 died... 13:23:43.929242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25771): Terminated: ok {rc=0} 13:23:44.018857 bus /gobi_0: Setting Powered False 13:23:45.118819 bus /gobi_0: Setting Powered False 13:23:46.236806 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200 iperf3.py ---------------------------------------------- 13:23:47.406623 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:47.418918 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:23:47.472839 tst iperf3.py: using LAC 34234 13:23:47.628846 tst iperf3.py: using RAC 64 13:23:47.758258 tst iperf3.py: using CellId 34234 13:23:47.914763 tst iperf3.py: using BVCI 34235 13:23:48.067127 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.079920 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.095449 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.110917 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.121942 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.136747 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.147969 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.163229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:48.178926 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:48.313324 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:23:48.563526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:48.941510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25941): Launched 13:23:49.287137 run iperf3-srv_10.42.42.10(pid=25987): Launched 13:23:49.451452 tst iperf3.py:8: start network... 13:23:49.716567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:50.243622 run create_hlr_db(pid=26045): Launched 13:23:50.404934 bus /gobi_6: Setting Powered False 13:23:51.471018 run create_hlr_db(pid=26045): Terminated: ok {rc=0} 13:23:51.940931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Launched 13:23:52.287708 run osmo-hlr_10.42.42.2(pid=26050): Launched 13:23:52.540803 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:53.218873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Launched 13:23:53.540867 run osmo-stp_10.42.42.5(pid=26053): Launched 13:23:53.780072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:54.454039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Launched 13:23:54.584688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:54.849767 run patchelf(pid=26056): Launched 13:23:55.038486 run osmo-stp_10.42.42.5(pid=26053): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] 13:23:55.171505 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-13_13:23:53.482909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:55.306271 run osmo-stp_10.42.42.5(pid=26053): stderr: | 20221213132353803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132353803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132353804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132353804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132353804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132353804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132353813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:55.440764 run osmo-stp_10.42.42.5(pid=26053): stdout: | (launched: 2022-12-13_13:23:53.482909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:55.569259 run osmo-stp_10.42.42.5(pid=26053): stderr: | 20221213132353803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132353803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132353804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132353804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132353804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132353804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132353813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:55.721945 run patchelf(pid=26056): Terminating (SIGINT) 13:23:55.898716 run patchelf(pid=26056): Terminated: ok {rc=0} 13:23:56.026105 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2390↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] [trial-2390↪gprs:trx-b200↪iperf3.py:8] 13:23:56.036666 tst iperf3.py:8: Test FAILED (8.7 sec) 13:23:56.065394 run osmo-hlr_10.42.42.2(pid=26050): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26050)] 13:23:56.114850 run osmo-hlr_10.42.42.2(pid=26050): stdout: | (launched: 2022-12-13_13:23:52.227520) 13:23:56.166035 run osmo-hlr_10.42.42.2(pid=26050): stderr: | 20221213132352533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132352533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132352533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132352533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132352534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132352534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132352553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132352561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132352562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132352562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:56.217660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25941): Terminating (SIGTERM) 13:23:56.259984 run iperf3-srv_10.42.42.10(pid=25987): Terminating (SIGTERM) 13:23:56.305079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminating (SIGTERM) 13:23:56.347320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminating (SIGTERM) 13:23:56.390983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminating (SIGTERM) 13:23:56.434993 --- ParallelTerminationStrategy: PID 25941 died... 13:23:56.454917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25941): Terminated: ok {rc=0} 13:23:56.501871 --- ParallelTerminationStrategy: PID 25987 died... 13:23:56.521186 run iperf3-srv_10.42.42.10(pid=25987): Terminated {rc=256} 13:23:56.566011 --- ParallelTerminationStrategy: PID 26049 died... 13:23:56.585338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26049): Terminated: ok {rc=0} 13:23:56.630318 --- ParallelTerminationStrategy: PID 26052 died... 13:23:56.649717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26052): Terminated: ok {rc=0} 13:23:56.694643 --- ParallelTerminationStrategy: PID 26055 died... 13:23:56.714003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26055): Terminated: ok {rc=0} 13:23:56.800884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 13:23:57.953550 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:57.965754 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:23:58.016534 tst iperf3m4.py: using LAC 34235 13:23:58.141388 tst iperf3m4.py: using RAC 65 13:23:58.266453 tst iperf3m4.py: using CellId 34235 13:23:58.391260 tst iperf3m4.py: using BVCI 34236 13:23:58.509292 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.521010 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.533897 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.545399 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.557928 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.569945 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.582549 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.594592 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:23:58.606746 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:58.730511 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:58.854508 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:58.977957 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:23:59.099969 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:23:59.313678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:59.634298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Launched 13:23:59.926933 run iperf3-srv_10.42.42.10(pid=26058): Launched 13:24:00.065661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:24:00.279071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:00.600920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Launched 13:24:00.895233 run iperf3-srv_10.42.42.10(pid=26060): Launched 13:24:01.047956 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:24:01.311504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:01.693894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Launched 13:24:02.040649 run iperf3-srv_10.42.42.10(pid=26062): Launched 13:24:02.189639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:24:02.443313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:02.829685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Launched 13:24:03.166829 run iperf3-srv_10.42.42.10(pid=26064): Launched 13:24:03.321890 tst iperf3m4.py:8: start network... 13:24:03.569467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:04.063309 run create_hlr_db(pid=26065): Launched 13:24:04.229718 bus /gobi_6: Setting Powered False 13:24:05.292128 run create_hlr_db(pid=26065): Terminated: ok {rc=0} 13:24:05.737470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Launched 13:24:06.066337 run osmo-hlr_10.42.42.2(pid=26068): Launched 13:24:06.304712 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:07.027518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Launched 13:24:07.359949 run osmo-stp_10.42.42.5(pid=26071): Launched 13:24:07.607926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:08.295174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Launched 13:24:08.429127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:08.698385 run patchelf(pid=26074): Launched 13:24:08.891341 run osmo-stp_10.42.42.5(pid=26071): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] 13:24:09.027991 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-13_13:24:07.299198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:09.165323 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221213132407629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132407629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132407629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132407630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132407630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132407630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132407630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:09.301239 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-13_13:24:07.299198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:09.433117 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221213132407629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132407629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132407629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132407630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132407630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132407630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132407630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:09.588771 run patchelf(pid=26074): Terminating (SIGINT) 13:24:09.771374 run patchelf(pid=26074): Terminated: ok {rc=0} 13:24:09.900069 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2390↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] [trial-2390↪gprs:trx-b200↪iperf3m4.py:8] 13:24:09.911427 tst iperf3m4.py:8: Test FAILED (12.0 sec) 13:24:09.942623 run osmo-hlr_10.42.42.2(pid=26068): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26068)] 13:24:09.994259 run osmo-hlr_10.42.42.2(pid=26068): stdout: | (launched: 2022-12-13_13:24:06.007189) 13:24:10.046751 run osmo-hlr_10.42.42.2(pid=26068): stderr: | 20221213132406347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132406347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132406347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132406347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132406347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132406347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132406362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132406378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132406379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132406379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:10.099045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminating (SIGTERM) 13:24:10.142926 run iperf3-srv_10.42.42.10(pid=26058): Terminating (SIGTERM) 13:24:10.187837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminating (SIGTERM) 13:24:10.231125 run iperf3-srv_10.42.42.10(pid=26060): Terminating (SIGTERM) 13:24:10.276639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminating (SIGTERM) 13:24:10.320171 run iperf3-srv_10.42.42.10(pid=26062): Terminating (SIGTERM) 13:24:10.367337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminating (SIGTERM) 13:24:10.410311 run iperf3-srv_10.42.42.10(pid=26064): Terminating (SIGTERM) 13:24:10.455746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminating (SIGTERM) 13:24:10.498912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminating (SIGTERM) 13:24:10.544448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminating (SIGTERM) 13:24:10.590098 --- ParallelTerminationStrategy: PID 26057 died... 13:24:10.610628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminated: ok {rc=0} 13:24:10.659094 --- ParallelTerminationStrategy: PID 26058 died... 13:24:10.679706 run iperf3-srv_10.42.42.10(pid=26058): Terminated {rc=256} 13:24:10.727662 --- ParallelTerminationStrategy: PID 26059 died... 13:24:10.749069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminated: ok {rc=0} 13:24:10.795208 --- ParallelTerminationStrategy: PID 26060 died... 13:24:10.816066 run iperf3-srv_10.42.42.10(pid=26060): Terminated {rc=256} 13:24:10.862529 --- ParallelTerminationStrategy: PID 26061 died... 13:24:10.883628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminated: ok {rc=0} 13:24:10.929856 --- ParallelTerminationStrategy: PID 26062 died... 13:24:10.951067 run iperf3-srv_10.42.42.10(pid=26062): Terminated {rc=256} 13:24:10.998109 --- ParallelTerminationStrategy: PID 26063 died... 13:24:11.018714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminated: ok {rc=0} 13:24:11.065070 --- ParallelTerminationStrategy: PID 26064 died... 13:24:11.085256 run iperf3-srv_10.42.42.10(pid=26064): Terminated {rc=256} 13:24:11.133151 --- ParallelTerminationStrategy: PID 26067 died... 13:24:11.153375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminated: ok {rc=0} 13:24:11.200301 --- ParallelTerminationStrategy: PID 26070 died... 13:24:11.221117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminated: ok {rc=0} 13:24:11.267714 --- ParallelTerminationStrategy: PID 26073 died... 13:24:11.288289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminated: ok {rc=0} 13:24:11.381827 bus /gobi_4: Setting Powered False 13:24:12.481759 bus /gobi_4: Setting Powered False 13:24:13.601503 bus /gobi_1: Setting Powered False 13:24:14.700251 bus /gobi_1: Setting Powered False 13:24:15.816673 bus /gobi_0: Setting Powered False 13:24:16.939328 bus /gobi_0: Setting Powered False 13:24:18.065041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200 ping.py ---------------------------------------------- 13:24:19.164915 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.176001 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:24:19.224812 tst ping.py: using LAC 34236 13:24:19.343269 tst ping.py: using RAC 66 13:24:19.462758 tst ping.py: using CellId 34236 13:24:19.582736 tst ping.py: using BVCI 34237 13:24:19.693950 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.704443 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.714914 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.725332 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.735576 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.745988 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.756550 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:19.767111 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:24:19.882716 tst ping.py:19: start network... 13:24:20.083395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:20.547725 run create_hlr_db(pid=26076): Launched 13:24:20.670992 bus /gobi_6: Setting Powered False 13:24:21.730576 run create_hlr_db(pid=26076): Terminated: ok {rc=0} 13:24:22.150279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26078): Launched 13:24:22.452931 run osmo-hlr_10.42.42.2(pid=26079): Launched 13:24:22.566404 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:23.087398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26081): Launched 13:24:23.387985 run osmo-stp_10.42.42.5(pid=26082): Launched 13:24:23.501523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:24.017461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26084): Launched 13:24:24.133180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:24.387691 run patchelf(pid=26085): Launched 13:24:24.554585 run osmo-stp_10.42.42.5(pid=26082): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26082)] 13:24:24.681873 run osmo-stp_10.42.42.5(pid=26082): stdout: | (launched: 2022-12-13_13:24:23.331779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:24.810651 run osmo-stp_10.42.42.5(pid=26082): stderr: | 20221213132423501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132423501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132423501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132423502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132423502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132423502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132423502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:24.939676 run osmo-stp_10.42.42.5(pid=26082): stdout: | (launched: 2022-12-13_13:24:23.331779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:25.062890 run osmo-stp_10.42.42.5(pid=26082): stderr: | 20221213132423501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132423501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132423501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132423502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132423502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132423502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132423502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:25.208786 run patchelf(pid=26085): Terminating (SIGINT) 13:24:25.377719 run patchelf(pid=26085): Terminated: ok {rc=0} 13:24:25.499501 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26082): Process ended prematurely: osmo-stp_10.42.42.5(pid=26082) [trial-2390↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26082)] [trial-2390↪gprs:trx-b200↪ping.py:22] 13:24:25.508448 tst ping.py:22: Test FAILED (6.3 sec) 13:24:25.535702 run osmo-hlr_10.42.42.2(pid=26079): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26079)] 13:24:25.583635 run osmo-hlr_10.42.42.2(pid=26079): stdout: | (launched: 2022-12-13_13:24:22.396750) 13:24:25.632531 run osmo-hlr_10.42.42.2(pid=26079): stderr: | 20221213132422571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132422571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132422571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132422571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132422571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132422571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132422583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132422592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132422593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132422593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:25.682122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26078): Terminating (SIGTERM) 13:24:25.721851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26081): Terminating (SIGTERM) 13:24:25.761722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26084): Terminating (SIGTERM) 13:24:25.802260 --- ParallelTerminationStrategy: PID 26078 died... 13:24:25.821600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26078): Terminated: ok {rc=0} 13:24:25.865630 --- ParallelTerminationStrategy: PID 26081 died... 13:24:25.884439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26081): Terminated: ok {rc=0} 13:24:25.928442 --- ParallelTerminationStrategy: PID 26084 died... 13:24:25.947095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26084): Terminated: ok {rc=0} 13:24:26.032302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 13:24:27.120413 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.131728 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:24:27.185428 tst ping_idle_ping.py: using LAC 34237 13:24:27.310779 tst ping_idle_ping.py: using RAC 67 13:24:27.436721 tst ping_idle_ping.py: using CellId 34237 13:24:27.559501 tst ping_idle_ping.py: using BVCI 34238 13:24:27.670088 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.680843 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.691602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.702288 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.712619 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.723013 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.734113 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:24:27.745032 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:24:27.860387 tst ping_idle_ping.py:24: start network... 13:24:28.078569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:28.582485 run create_hlr_db(pid=26086): Launched 13:24:28.707889 bus /gobi_6: Setting Powered False 13:24:29.771914 run create_hlr_db(pid=26086): Terminated: ok {rc=0} 13:24:30.205809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26088): Launched 13:24:30.507983 run osmo-hlr_10.42.42.2(pid=26089): Launched 13:24:30.622641 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:31.185928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26091): Launched 13:24:31.524500 run osmo-stp_10.42.42.5(pid=26092): Launched 13:24:31.747107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:32.330581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26094): Launched 13:24:32.458125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:32.713390 run patchelf(pid=26095): Launched 13:24:32.882418 run osmo-stp_10.42.42.5(pid=26092): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26092)] 13:24:33.010459 run osmo-stp_10.42.42.5(pid=26092): stdout: | (launched: 2022-12-13_13:24:31.460401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:33.141134 run osmo-stp_10.42.42.5(pid=26092): stderr: | 20221213132431678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132431678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132431678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132431678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132431679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132431679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132431679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:33.271074 run osmo-stp_10.42.42.5(pid=26092): stdout: | (launched: 2022-12-13_13:24:31.460401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:33.394549 run osmo-stp_10.42.42.5(pid=26092): stderr: | 20221213132431678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132431678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132431678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132431678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132431679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132431679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132431679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:33.541080 run patchelf(pid=26095): Terminating (SIGINT) 13:24:33.710854 run patchelf(pid=26095): Terminated: ok {rc=0} 13:24:33.833543 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26092): Process ended prematurely: osmo-stp_10.42.42.5(pid=26092) [trial-2390↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26092)] [trial-2390↪gprs:trx-b200↪ping_idle_ping.py:27] 13:24:33.842557 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:24:33.869467 run osmo-hlr_10.42.42.2(pid=26089): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26089)] 13:24:33.917330 run osmo-hlr_10.42.42.2(pid=26089): stdout: | (launched: 2022-12-13_13:24:30.451932) 13:24:33.966952 run osmo-hlr_10.42.42.2(pid=26089): stderr: | 20221213132430626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132430626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132430626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132430626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132430626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132430626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132430638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132430647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132430647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132430647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:34.017514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26088): Terminating (SIGTERM) 13:24:34.057749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26091): Terminating (SIGTERM) 13:24:34.097962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26094): Terminating (SIGTERM) 13:24:34.138382 --- ParallelTerminationStrategy: PID 26088 died... 13:24:34.157840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26088): Terminated: ok {rc=0} 13:24:34.202280 --- ParallelTerminationStrategy: PID 26091 died... 13:24:34.221580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26091): Terminated: ok {rc=0} 13:24:34.265877 --- ParallelTerminationStrategy: PID 26094 died... 13:24:34.284675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26094): Terminated: ok {rc=0} 13:24:34.369501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 13:24:35.683759 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:35.690064 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:24:35.725349 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:24:35.765887 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:24:35.855594 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:24:35.889362 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:24:35.928674 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:24:36.524151 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:24:36.577650 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:36.588833 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:24:36.641241 tst cs_paging_gprs_active.py: using LAC 34238 13:24:36.771051 tst cs_paging_gprs_active.py: using RAC 68 13:24:36.903835 tst cs_paging_gprs_active.py: using CellId 34238 13:24:37.033485 tst cs_paging_gprs_active.py: using BVCI 34239 13:24:37.148366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.159491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.170210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.181018 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.191742 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.203015 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.213967 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.224645 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:37.235585 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:24:37.357718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:24:37.479988 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:24:37.702716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:38.034310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Launched 13:24:38.323665 run iperf3-srv_10.42.42.10(pid=26101): Launched 13:24:38.448757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:24:38.670902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:39.002884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Launched 13:24:39.291351 run iperf3-srv_10.42.42.10(pid=26103): Launched 13:24:39.416006 tst cs_paging_gprs_active.py:38: start network... 13:24:39.637304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:40.148116 run create_hlr_db(pid=26104): Launched 13:24:40.273578 bus /gobi_6: Setting Powered False 13:24:41.337857 run create_hlr_db(pid=26104): Terminated: ok {rc=0} 13:24:41.776625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Launched 13:24:42.084865 run osmo-hlr_10.42.42.2(pid=26107): Launched 13:24:42.201614 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:42.732877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Launched 13:24:43.040332 run osmo-stp_10.42.42.5(pid=26110): Launched 13:24:43.158787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:43.689658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Launched 13:24:43.807162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:44.066636 run patchelf(pid=26113): Launched 13:24:44.237118 run osmo-stp_10.42.42.5(pid=26110): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] 13:24:44.366522 run osmo-stp_10.42.42.5(pid=26110): stdout: | (launched: 2022-12-13_13:24:42.983397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:44.497494 run osmo-stp_10.42.42.5(pid=26110): stderr: | 20221213132443151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132443151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132443151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132443152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132443152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132443152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132443152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:44.628465 run osmo-stp_10.42.42.5(pid=26110): stdout: | (launched: 2022-12-13_13:24:42.983397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:44.753887 run osmo-stp_10.42.42.5(pid=26110): stderr: | 20221213132443151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132443151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132443151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132443152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132443152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132443152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132443152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:44.902338 run patchelf(pid=26113): Terminating (SIGINT) 13:24:45.074561 run patchelf(pid=26113): Terminated: ok {rc=0} 13:24:45.199967 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26110): Process ended prematurely: osmo-stp_10.42.42.5(pid=26110) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:24:45.209691 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:24:45.236445 run osmo-hlr_10.42.42.2(pid=26107): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26107)] 13:24:45.283919 run osmo-hlr_10.42.42.2(pid=26107): stdout: | (launched: 2022-12-13_13:24:42.027821) 13:24:45.333027 run osmo-hlr_10.42.42.2(pid=26107): stderr: | 20221213132442201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132442201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132442201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132442201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132442201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132442201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132442212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132442221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132442221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132442221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:45.382749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminating (SIGTERM) 13:24:45.422492 run iperf3-srv_10.42.42.10(pid=26101): Terminating (SIGTERM) 13:24:45.462097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Terminating (SIGTERM) 13:24:45.501685 run iperf3-srv_10.42.42.10(pid=26103): Terminating (SIGTERM) 13:24:45.541068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Terminating (SIGTERM) 13:24:45.580617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Terminating (SIGTERM) 13:24:45.620388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Terminating (SIGTERM) 13:24:45.660120 --- ParallelTerminationStrategy: PID 26100 died... 13:24:45.679234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminated: ok {rc=0} 13:24:45.722794 --- ParallelTerminationStrategy: PID 26101 died... 13:24:45.741309 run iperf3-srv_10.42.42.10(pid=26101): Terminated {rc=256} 13:24:45.784915 --- ParallelTerminationStrategy: PID 26102 died... 13:24:45.803866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Terminated: ok {rc=0} 13:24:45.868145 --- ParallelTerminationStrategy: PID 26103 died... 13:24:45.899014 run iperf3-srv_10.42.42.10(pid=26103): Terminated {rc=256} 13:24:45.943915 --- ParallelTerminationStrategy: PID 26106 died... 13:24:45.963152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Terminated: ok {rc=0} 13:24:46.009067 --- ParallelTerminationStrategy: PID 26109 died... 13:24:46.035364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Terminated: ok {rc=0} 13:24:46.086792 --- ParallelTerminationStrategy: PID 26112 died... 13:24:46.106753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Terminated: ok {rc=0} 13:24:46.223115 bus /gobi_0: Setting Powered False 13:24:47.335550 bus /gobi_0: Setting Powered False 13:24:48.447862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:24:49.599561 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:49.611366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:24:49.666285 tst iperf3.py: using LAC 34239 13:24:49.789859 tst iperf3.py: using RAC 69 13:24:49.920940 tst iperf3.py: using CellId 34239 13:24:50.054353 tst iperf3.py: using BVCI 34240 13:24:50.175566 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.186998 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.198162 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.209253 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.220607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.231978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.243501 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.254752 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:50.266268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:24:50.384482 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:24:50.592068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:50.901677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26114): Launched 13:24:51.170769 run iperf3-srv_10.42.42.10(pid=26115): Launched 13:24:51.289538 tst iperf3.py:8: start network... 13:24:51.495678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:51.972126 run create_hlr_db(pid=26116): Launched 13:24:52.099173 bus /gobi_6: Setting Powered False 13:24:53.159408 run create_hlr_db(pid=26116): Terminated: ok {rc=0} 13:24:53.609145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Launched 13:24:53.940769 run osmo-hlr_10.42.42.2(pid=26119): Launched 13:24:54.065992 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:54.633627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Launched 13:24:54.965576 run osmo-stp_10.42.42.5(pid=26122): Launched 13:24:55.093087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:55.660792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Launched 13:24:55.788334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:56.066196 run patchelf(pid=26125): Launched 13:24:56.249746 run osmo-stp_10.42.42.5(pid=26122): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] 13:24:56.389239 run osmo-stp_10.42.42.5(pid=26122): stdout: | (launched: 2022-12-13_13:24:54.904669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:56.530341 run osmo-stp_10.42.42.5(pid=26122): stderr: | 20221213132455095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132455096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132455096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132455096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132455097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132455097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132455097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:56.671551 run osmo-stp_10.42.42.5(pid=26122): stdout: | (launched: 2022-12-13_13:24:54.904669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:56.806889 run osmo-stp_10.42.42.5(pid=26122): stderr: | 20221213132455095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132455096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132455096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132455096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132455097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132455097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132455097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:56.966828 run patchelf(pid=26125): Terminating (SIGINT) 13:24:57.152238 run patchelf(pid=26125): Terminated: ok {rc=0} 13:24:57.285743 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26122): Process ended prematurely: osmo-stp_10.42.42.5(pid=26122) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 13:24:57.296062 tst iperf3.py:8: Test FAILED (7.7 sec) 13:24:57.324715 run osmo-hlr_10.42.42.2(pid=26119): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26119)] 13:24:57.375841 run osmo-hlr_10.42.42.2(pid=26119): stdout: | (launched: 2022-12-13_13:24:53.880078) 13:24:57.428268 run osmo-hlr_10.42.42.2(pid=26119): stderr: | 20221213132454078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132454078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132454078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132454078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132454078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132454078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132454091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132454099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132454099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132454099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:57.480875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26114): Terminating (SIGTERM) 13:24:57.523059 run iperf3-srv_10.42.42.10(pid=26115): Terminating (SIGTERM) 13:24:57.565880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Terminating (SIGTERM) 13:24:57.608265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Terminating (SIGTERM) 13:24:57.650757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Terminating (SIGTERM) 13:24:57.693480 --- ParallelTerminationStrategy: PID 26114 died... 13:24:57.713998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26114): Terminated: ok {rc=0} 13:24:57.760832 --- ParallelTerminationStrategy: PID 26115 died... 13:24:57.780863 run iperf3-srv_10.42.42.10(pid=26115): Terminated {rc=256} 13:24:57.827370 --- ParallelTerminationStrategy: PID 26118 died... 13:24:57.847215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Terminated: ok {rc=0} 13:24:57.893481 --- ParallelTerminationStrategy: PID 26121 died... 13:24:57.913336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Terminated: ok {rc=0} 13:24:57.959791 --- ParallelTerminationStrategy: PID 26124 died... 13:24:57.979749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Terminated: ok {rc=0} 13:24:58.069333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:24:59.219936 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.232272 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:24:59.285388 tst iperf3m4.py: using LAC 34240 13:24:59.417109 tst iperf3m4.py: using RAC 70 13:24:59.545901 tst iperf3m4.py: using CellId 34240 13:24:59.669170 tst iperf3m4.py: using BVCI 34241 13:24:59.782753 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.794075 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.804911 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.815846 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.826907 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.837792 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.848693 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.859558 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:24:59.870528 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:24:59.993468 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:00.113379 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:00.235332 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:00.357547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:00.579791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:00.915474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Launched 13:25:01.222314 run iperf3-srv_10.42.42.10(pid=26127): Launched 13:25:01.359323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:25:01.585225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:01.983195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Launched 13:25:02.284056 run iperf3-srv_10.42.42.10(pid=26132): Launched 13:25:02.399731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:25:02.604292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:02.911435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Launched 13:25:03.178009 run iperf3-srv_10.42.42.10(pid=26134): Launched 13:25:03.293446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:25:03.497858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:03.804138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26135): Launched 13:25:04.070875 run iperf3-srv_10.42.42.10(pid=26136): Launched 13:25:04.186442 tst iperf3m4.py:8: start network... 13:25:04.390438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:04.867058 run create_hlr_db(pid=26137): Launched 13:25:04.993087 bus /gobi_6: Setting Powered False 13:25:06.053613 run create_hlr_db(pid=26137): Terminated: ok {rc=0} 13:25:06.480349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26139): Launched 13:25:06.787768 run osmo-hlr_10.42.42.2(pid=26140): Launched 13:25:06.903212 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:07.430259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26142): Launched 13:25:07.738680 run osmo-stp_10.42.42.5(pid=26143): Launched 13:25:07.856622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:08.387410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26145): Launched 13:25:08.506358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:08.765586 run patchelf(pid=26147): Launched 13:25:08.936530 run osmo-stp_10.42.42.5(pid=26143): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26143)] 13:25:09.066830 run osmo-stp_10.42.42.5(pid=26143): stdout: | (launched: 2022-12-13_13:25:07.681262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:09.198827 run osmo-stp_10.42.42.5(pid=26143): stderr: | 20221213132507852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132507852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132507852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132507853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132507853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132507853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132507854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:09.331226 run osmo-stp_10.42.42.5(pid=26143): stdout: | (launched: 2022-12-13_13:25:07.681262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:09.457656 run osmo-stp_10.42.42.5(pid=26143): stderr: | 20221213132507852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132507852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132507852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132507853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132507853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132507853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132507854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:09.607212 run patchelf(pid=26147): Terminating (SIGINT) 13:25:09.780561 run patchelf(pid=26147): Terminated: ok {rc=0} 13:25:09.904842 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26143): Process ended prematurely: osmo-stp_10.42.42.5(pid=26143) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26143)] [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 13:25:09.914442 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:25:09.941838 run osmo-hlr_10.42.42.2(pid=26140): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26140)] 13:25:09.989653 run osmo-hlr_10.42.42.2(pid=26140): stdout: | (launched: 2022-12-13_13:25:06.730403) 13:25:10.038769 run osmo-hlr_10.42.42.2(pid=26140): stderr: | 20221213132506903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132506903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132506904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132506904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132506904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132506904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132506916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132506924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132506924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132506924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:10.088392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Terminating (SIGTERM) 13:25:10.128393 run iperf3-srv_10.42.42.10(pid=26127): Terminating (SIGTERM) 13:25:10.168372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminating (SIGTERM) 13:25:10.208668 run iperf3-srv_10.42.42.10(pid=26132): Terminating (SIGTERM) 13:25:10.248860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminating (SIGTERM) 13:25:10.289058 run iperf3-srv_10.42.42.10(pid=26134): Terminating (SIGTERM) 13:25:10.329171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26135): Terminating (SIGTERM) 13:25:10.369203 run iperf3-srv_10.42.42.10(pid=26136): Terminating (SIGTERM) 13:25:10.409300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26139): Terminating (SIGTERM) 13:25:10.449411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26142): Terminating (SIGTERM) 13:25:10.489478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26145): Terminating (SIGTERM) 13:25:10.530116 --- ParallelTerminationStrategy: PID 26126 died... 13:25:10.549680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Terminated: ok {rc=0} 13:25:10.594216 --- ParallelTerminationStrategy: PID 26127 died... 13:25:10.613180 run iperf3-srv_10.42.42.10(pid=26127): Terminated {rc=256} 13:25:10.657212 --- ParallelTerminationStrategy: PID 26131 died... 13:25:10.675780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26131): Terminated: ok {rc=0} 13:25:10.719818 --- ParallelTerminationStrategy: PID 26132 died... 13:25:10.738691 run iperf3-srv_10.42.42.10(pid=26132): Terminated {rc=256} 13:25:10.782683 --- ParallelTerminationStrategy: PID 26133 died... 13:25:10.801427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminated: ok {rc=0} 13:25:10.845624 --- ParallelTerminationStrategy: PID 26134 died... 13:25:10.864374 run iperf3-srv_10.42.42.10(pid=26134): Terminated {rc=256} 13:25:10.908334 --- ParallelTerminationStrategy: PID 26135 died... 13:25:10.927170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26135): Terminated: ok {rc=0} 13:25:10.971105 --- ParallelTerminationStrategy: PID 26136 died... 13:25:10.990003 run iperf3-srv_10.42.42.10(pid=26136): Terminated {rc=256} 13:25:11.033893 --- ParallelTerminationStrategy: PID 26139 died... 13:25:11.052627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26139): Terminated: ok {rc=0} 13:25:11.097066 --- ParallelTerminationStrategy: PID 26142 died... 13:25:11.116071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26142): Terminated: ok {rc=0} 13:25:11.160182 --- ParallelTerminationStrategy: PID 26145 died... 13:25:11.179120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26145): Terminated: ok {rc=0} 13:25:11.262840 bus /gobi_4: Setting Powered False 13:25:12.360282 bus /gobi_4: Setting Powered False 13:25:13.474661 bus /gobi_1: Setting Powered False 13:25:14.575607 bus /gobi_1: Setting Powered False 13:25:15.692464 bus /gobi_0: Setting Powered False 13:25:16.804572 bus /gobi_0: Setting Powered False 13:25:17.941286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 13:25:19.045526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.056905 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:25:19.108079 tst ping.py: using LAC 34241 13:25:19.236680 tst ping.py: using RAC 71 13:25:19.363523 tst ping.py: using CellId 34241 13:25:19.491635 tst ping.py: using BVCI 34242 13:25:19.611414 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.623068 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.634491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.645734 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.657249 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.668655 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.680320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:19.691835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:19.808297 tst ping.py:19: start network... 13:25:20.010598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:20.479178 run create_hlr_db(pid=26148): Launched 13:25:20.603790 bus /gobi_6: Setting Powered False 13:25:21.663515 run create_hlr_db(pid=26148): Terminated: ok {rc=0} 13:25:22.105212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Launched 13:25:22.429874 run osmo-hlr_10.42.42.2(pid=26151): Launched 13:25:22.554106 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:23.118712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Launched 13:25:23.442217 run osmo-stp_10.42.42.5(pid=26154): Launched 13:25:23.566749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:24.124225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Launched 13:25:24.247500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:24.520122 run patchelf(pid=26157): Launched 13:25:24.699404 run osmo-stp_10.42.42.5(pid=26154): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] 13:25:24.836117 run osmo-stp_10.42.42.5(pid=26154): stdout: | (launched: 2022-12-13_13:25:23.382605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:24.974258 run osmo-stp_10.42.42.5(pid=26154): stderr: | 20221213132523572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132523572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132523573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132523573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132523574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132523574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132523574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:25.112042 run osmo-stp_10.42.42.5(pid=26154): stdout: | (launched: 2022-12-13_13:25:23.382605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:25.244044 run osmo-stp_10.42.42.5(pid=26154): stderr: | 20221213132523572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132523572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132523573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132523573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132523574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132523574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132523574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:25.400229 run patchelf(pid=26157): Terminating (SIGINT) 13:25:25.580704 run patchelf(pid=26157): Terminated: ok {rc=0} 13:25:25.711212 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26154): Process ended prematurely: osmo-stp_10.42.42.5(pid=26154) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 13:25:25.720837 tst ping.py:22: Test FAILED (6.7 sec) 13:25:25.749226 run osmo-hlr_10.42.42.2(pid=26151): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26151)] 13:25:25.800044 run osmo-hlr_10.42.42.2(pid=26151): stdout: | (launched: 2022-12-13_13:25:22.370128) 13:25:25.852110 run osmo-hlr_10.42.42.2(pid=26151): stderr: | 20221213132522566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132522566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132522566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132522566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132522566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132522566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132522579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132522587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132522588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132522588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:25.904067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Terminating (SIGTERM) 13:25:25.946082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Terminating (SIGTERM) 13:25:25.988015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Terminating (SIGTERM) 13:25:26.030837 --- ParallelTerminationStrategy: PID 26150 died... 13:25:26.051286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Terminated: ok {rc=0} 13:25:26.097689 --- ParallelTerminationStrategy: PID 26153 died... 13:25:26.117505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Terminated: ok {rc=0} 13:25:26.164302 --- ParallelTerminationStrategy: PID 26156 died... 13:25:26.184233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Terminated: ok {rc=0} 13:25:26.272203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:25:27.360150 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.372119 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:25:27.424269 tst ping_idle_ping.py: using LAC 34242 13:25:27.544719 tst ping_idle_ping.py: using RAC 72 13:25:27.664125 tst ping_idle_ping.py: using CellId 34242 13:25:27.783863 tst ping_idle_ping.py: using BVCI 34243 13:25:27.902335 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.913814 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.925039 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.936141 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.947751 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.959138 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.971008 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.982535 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:28.101467 tst ping_idle_ping.py:24: start network... 13:25:28.303069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:28.771197 run create_hlr_db(pid=26158): Launched 13:25:28.894357 bus /gobi_6: Setting Powered False 13:25:29.955035 run create_hlr_db(pid=26158): Terminated: ok {rc=0} 13:25:30.398981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Launched 13:25:30.725483 run osmo-hlr_10.42.42.2(pid=26161): Launched 13:25:30.889877 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:31.596265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Launched 13:25:31.938201 run osmo-stp_10.42.42.5(pid=26164): Launched 13:25:32.232304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:32.795330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Launched 13:25:32.921133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:33.195590 run patchelf(pid=26167): Launched 13:25:33.377173 run osmo-stp_10.42.42.5(pid=26164): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] 13:25:33.514216 run osmo-stp_10.42.42.5(pid=26164): stdout: | (launched: 2022-12-13_13:25:31.878001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:33.653418 run osmo-stp_10.42.42.5(pid=26164): stderr: | 20221213132532098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132532099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132532099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132532099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132532100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132532100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132532100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:33.792527 run osmo-stp_10.42.42.5(pid=26164): stdout: | (launched: 2022-12-13_13:25:31.878001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:33.925173 run osmo-stp_10.42.42.5(pid=26164): stderr: | 20221213132532098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132532099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132532099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132532099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132532100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132532100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132532100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:34.082583 run patchelf(pid=26167): Terminating (SIGINT) 13:25:34.264931 run patchelf(pid=26167): Terminated: ok {rc=0} 13:25:34.396391 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26164): Process ended prematurely: osmo-stp_10.42.42.5(pid=26164) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 13:25:34.406190 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 13:25:34.434665 run osmo-hlr_10.42.42.2(pid=26161): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26161)] 13:25:34.485366 run osmo-hlr_10.42.42.2(pid=26161): stdout: | (launched: 2022-12-13_13:25:30.665373) 13:25:34.538013 run osmo-hlr_10.42.42.2(pid=26161): stderr: | 20221213132530911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132530911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132530911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132530911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132530911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132530911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132530934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132530944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132530944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132530944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:34.590911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Terminating (SIGTERM) 13:25:34.633188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Terminating (SIGTERM) 13:25:34.675977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Terminating (SIGTERM) 13:25:34.719220 --- ParallelTerminationStrategy: PID 26160 died... 13:25:34.739848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Terminated: ok {rc=0} 13:25:34.787161 --- ParallelTerminationStrategy: PID 26163 died... 13:25:34.807705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Terminated: ok {rc=0} 13:25:34.855013 --- ParallelTerminationStrategy: PID 26166 died... 13:25:34.875233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Terminated: ok {rc=0} 13:25:34.964861 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:25:36.272827 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:25:36.279475 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:25:36.312707 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:25:36.351849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:25:36.438942 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:25:36.471664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:25:36.509756 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:25:37.109985 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:25:37.164281 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.175666 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:25:37.248449 tst cs_paging_gprs_active.py: using LAC 34243 13:25:37.377883 tst cs_paging_gprs_active.py: using RAC 73 13:25:37.506717 tst cs_paging_gprs_active.py: using CellId 34243 13:25:37.636889 tst cs_paging_gprs_active.py: using BVCI 34244 13:25:37.757880 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.769299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.780384 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.791638 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.803848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.815785 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.828024 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.839892 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:37.852181 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:25:37.972889 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:25:38.095039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:25:38.318058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:38.649534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26172): Launched 13:25:38.939320 run iperf3-srv_10.42.42.10(pid=26173): Launched 13:25:39.064635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:25:39.287005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:39.619194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26174): Launched 13:25:39.906738 run iperf3-srv_10.42.42.10(pid=26175): Launched 13:25:40.031647 tst cs_paging_gprs_active.py:38: start network... 13:25:40.253463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:40.764529 run create_hlr_db(pid=26176): Launched 13:25:40.890503 bus /gobi_6: Setting Powered False 13:25:41.955509 run create_hlr_db(pid=26176): Terminated: ok {rc=0} 13:25:42.413165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Launched 13:25:42.744454 run osmo-hlr_10.42.42.2(pid=26179): Launched 13:25:42.872224 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:43.442733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Launched 13:25:43.774346 run osmo-stp_10.42.42.5(pid=26182): Launched 13:25:43.902138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:44.469303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Launched 13:25:44.596702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:44.876042 run patchelf(pid=26185): Launched 13:25:45.060386 run osmo-stp_10.42.42.5(pid=26182): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] 13:25:45.199717 run osmo-stp_10.42.42.5(pid=26182): stdout: | (launched: 2022-12-13_13:25:43.713656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:45.340431 run osmo-stp_10.42.42.5(pid=26182): stderr: | 20221213132543904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132543904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132543904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132543905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132543905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132543905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132543905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:45.480691 run osmo-stp_10.42.42.5(pid=26182): stdout: | (launched: 2022-12-13_13:25:43.713656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:45.615399 run osmo-stp_10.42.42.5(pid=26182): stderr: | 20221213132543904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132543904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132543904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132543905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132543905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132543905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132543905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:45.775189 run patchelf(pid=26185): Terminating (SIGINT) 13:25:45.967405 run patchelf(pid=26185): Terminated: ok {rc=0} 13:25:46.102672 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26182): Process ended prematurely: osmo-stp_10.42.42.5(pid=26182) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:25:46.113767 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:25:46.143096 run osmo-hlr_10.42.42.2(pid=26179): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26179)] 13:25:46.194888 run osmo-hlr_10.42.42.2(pid=26179): stdout: | (launched: 2022-12-13_13:25:42.683811) 13:25:46.248259 run osmo-hlr_10.42.42.2(pid=26179): stderr: | 20221213132542882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132542882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132542882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132542882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132542882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132542883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132542895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132542904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132542904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132542904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:46.302073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26172): Terminating (SIGTERM) 13:25:46.345636 run iperf3-srv_10.42.42.10(pid=26173): Terminating (SIGTERM) 13:25:46.390145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26174): Terminating (SIGTERM) 13:25:46.434137 run iperf3-srv_10.42.42.10(pid=26175): Terminating (SIGTERM) 13:25:46.478821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Terminating (SIGTERM) 13:25:46.522245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Terminating (SIGTERM) 13:25:46.565412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Terminating (SIGTERM) 13:25:46.608643 --- ParallelTerminationStrategy: PID 26172 died... 13:25:46.629410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26172): Terminated: ok {rc=0} 13:25:46.677111 --- ParallelTerminationStrategy: PID 26173 died... 13:25:46.697497 run iperf3-srv_10.42.42.10(pid=26173): Terminated {rc=256} 13:25:46.744830 --- ParallelTerminationStrategy: PID 26174 died... 13:25:46.765688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26174): Terminated: ok {rc=0} 13:25:46.813327 --- ParallelTerminationStrategy: PID 26175 died... 13:25:46.833837 run iperf3-srv_10.42.42.10(pid=26175): Terminated {rc=256} 13:25:46.881105 --- ParallelTerminationStrategy: PID 26178 died... 13:25:46.901470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26178): Terminated: ok {rc=0} 13:25:46.948705 --- ParallelTerminationStrategy: PID 26181 died... 13:25:46.969251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26181): Terminated: ok {rc=0} 13:25:47.016526 --- ParallelTerminationStrategy: PID 26184 died... 13:25:47.037045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26184): Terminated: ok {rc=0} 13:25:47.126547 bus /gobi_0: Setting Powered False 13:25:48.226901 bus /gobi_0: Setting Powered False 13:25:49.343436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:25:50.488803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:50.500442 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:25:50.573408 tst iperf3.py: using LAC 34244 13:25:50.693548 tst iperf3.py: using RAC 74 13:25:50.825209 tst iperf3.py: using CellId 34244 13:25:50.954234 tst iperf3.py: using BVCI 34245 13:25:51.076048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.087698 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.099084 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.110540 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.122018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.133562 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.145116 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.156432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:25:51.168039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:25:51.285793 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:51.492073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:51.800393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26186): Launched 13:25:52.090933 run iperf3-srv_10.42.42.10(pid=26191): Launched 13:25:52.215936 tst iperf3.py:8: start network... 13:25:52.437944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:52.947618 run create_hlr_db(pid=26192): Launched 13:25:53.075129 bus /gobi_6: Setting Powered False 13:25:54.139254 run create_hlr_db(pid=26192): Terminated: ok {rc=0} 13:25:54.594986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26194): Launched 13:25:54.926304 run osmo-hlr_10.42.42.2(pid=26195): Launched 13:25:55.052900 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:55.625675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26197): Launched 13:25:55.955786 run osmo-stp_10.42.42.5(pid=26198): Launched 13:25:56.082567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:56.651911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Launched 13:25:56.777812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:57.056468 run patchelf(pid=26202): Launched 13:25:57.240446 run osmo-stp_10.42.42.5(pid=26198): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26198)] 13:25:57.379836 run osmo-stp_10.42.42.5(pid=26198): stdout: | (launched: 2022-12-13_13:25:55.895181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:57.520512 run osmo-stp_10.42.42.5(pid=26198): stderr: | 20221213132556083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132556083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132556084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132556084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132556085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132556085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132556085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:57.661076 run osmo-stp_10.42.42.5(pid=26198): stdout: | (launched: 2022-12-13_13:25:55.895181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:57.796203 run osmo-stp_10.42.42.5(pid=26198): stderr: | 20221213132556083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132556083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132556084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132556084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132556085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132556085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132556085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:57.956635 run patchelf(pid=26202): Terminating (SIGINT) 13:25:58.141952 run patchelf(pid=26202): Terminated: ok {rc=0} 13:25:58.275067 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26198): Process ended prematurely: osmo-stp_10.42.42.5(pid=26198) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26198)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 13:25:58.285370 tst iperf3.py:8: Test FAILED (7.8 sec) 13:25:58.314073 run osmo-hlr_10.42.42.2(pid=26195): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26195)] 13:25:58.365183 run osmo-hlr_10.42.42.2(pid=26195): stdout: | (launched: 2022-12-13_13:25:54.865600) 13:25:58.417976 run osmo-hlr_10.42.42.2(pid=26195): stderr: | 20221213132555062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132555062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132555062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132555063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132555063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132555063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132555075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132555083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132555084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132555084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:58.471025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26186): Terminating (SIGTERM) 13:25:58.513065 run iperf3-srv_10.42.42.10(pid=26191): Terminating (SIGTERM) 13:25:58.555937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26194): Terminating (SIGTERM) 13:25:58.598403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26197): Terminating (SIGTERM) 13:25:58.641364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminating (SIGTERM) 13:25:58.684509 --- ParallelTerminationStrategy: PID 26186 died... 13:25:58.705188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26186): Terminated: ok {rc=0} 13:25:58.752256 --- ParallelTerminationStrategy: PID 26191 died... 13:25:58.772346 run iperf3-srv_10.42.42.10(pid=26191): Terminated {rc=256} 13:25:58.819239 --- ParallelTerminationStrategy: PID 26194 died... 13:25:58.839218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26194): Terminated: ok {rc=0} 13:25:58.885737 --- ParallelTerminationStrategy: PID 26197 died... 13:25:58.905638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26197): Terminated: ok {rc=0} 13:25:58.951903 --- ParallelTerminationStrategy: PID 26201 died... 13:25:58.971835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminated: ok {rc=0} 13:25:59.060201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:26:00.211578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.223654 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:00.296284 tst iperf3m4.py: using LAC 34245 13:26:00.424812 tst iperf3m4.py: using RAC 75 13:26:00.554849 tst iperf3m4.py: using CellId 34245 13:26:00.676085 tst iperf3m4.py: using BVCI 34246 13:26:00.790561 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.801755 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.812738 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.823747 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.834622 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.858719 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.876513 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.898922 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:00.912339 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:01.047661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:01.181271 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:01.335606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:01.463555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:01.673778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:01.990209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Launched 13:26:02.274075 run iperf3-srv_10.42.42.10(pid=26204): Launched 13:26:02.390697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:26:02.597079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:02.906754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Launched 13:26:03.177679 run iperf3-srv_10.42.42.10(pid=26207): Launched 13:26:03.294173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:26:03.500613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:03.811828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Launched 13:26:04.080483 run iperf3-srv_10.42.42.10(pid=26209): Launched 13:26:04.196599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:26:04.402284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:04.710926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26210): Launched 13:26:04.981063 run iperf3-srv_10.42.42.10(pid=26211): Launched 13:26:05.096622 tst iperf3m4.py:8: start network... 13:26:05.301820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:05.777556 run create_hlr_db(pid=26212): Launched 13:26:05.905696 bus /gobi_6: Setting Powered False 13:26:06.966914 run create_hlr_db(pid=26212): Terminated: ok {rc=0} 13:26:07.394766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Launched 13:26:07.702996 run osmo-hlr_10.42.42.2(pid=26215): Launched 13:26:07.819391 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:08.352031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Launched 13:26:08.661838 run osmo-stp_10.42.42.5(pid=26218): Launched 13:26:08.778791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:09.309315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Launched 13:26:09.427154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:09.686542 run patchelf(pid=26221): Launched 13:26:09.859108 run osmo-stp_10.42.42.5(pid=26218): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] 13:26:09.989367 run osmo-stp_10.42.42.5(pid=26218): stdout: | (launched: 2022-12-13_13:26:08.604461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:10.121197 run osmo-stp_10.42.42.5(pid=26218): stderr: | 20221213132608774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132608774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132608774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132608775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132608775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132608775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132608776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:10.252579 run osmo-stp_10.42.42.5(pid=26218): stdout: | (launched: 2022-12-13_13:26:08.604461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:10.378531 run osmo-stp_10.42.42.5(pid=26218): stderr: | 20221213132608774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132608774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132608774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132608775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132608775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132608775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132608776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:10.527411 run patchelf(pid=26221): Terminating (SIGINT) 13:26:10.700659 run patchelf(pid=26221): Terminated: ok {rc=0} 13:26:10.824892 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26218): Process ended prematurely: osmo-stp_10.42.42.5(pid=26218) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:26:10.834549 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:26:10.862058 run osmo-hlr_10.42.42.2(pid=26215): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26215)] 13:26:10.909991 run osmo-hlr_10.42.42.2(pid=26215): stdout: | (launched: 2022-12-13_13:26:07.645624) 13:26:10.959508 run osmo-hlr_10.42.42.2(pid=26215): stderr: | 20221213132607824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132607824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132607824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132607824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132607824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132607824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132607839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132607848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132607848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132607848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:11.009391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminating (SIGTERM) 13:26:11.049894 run iperf3-srv_10.42.42.10(pid=26204): Terminating (SIGTERM) 13:26:11.090053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Terminating (SIGTERM) 13:26:11.130433 run iperf3-srv_10.42.42.10(pid=26207): Terminating (SIGTERM) 13:26:11.170534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Terminating (SIGTERM) 13:26:11.210934 run iperf3-srv_10.42.42.10(pid=26209): Terminating (SIGTERM) 13:26:11.250995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26210): Terminating (SIGTERM) 13:26:11.291206 run iperf3-srv_10.42.42.10(pid=26211): Terminating (SIGTERM) 13:26:11.331315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Terminating (SIGTERM) 13:26:11.371581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Terminating (SIGTERM) 13:26:11.411673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Terminating (SIGTERM) 13:26:11.452215 --- ParallelTerminationStrategy: PID 26203 died... 13:26:11.471752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminated: ok {rc=0} 13:26:11.516319 --- ParallelTerminationStrategy: PID 26204 died... 13:26:11.535213 run iperf3-srv_10.42.42.10(pid=26204): Terminated {rc=256} 13:26:11.579366 --- ParallelTerminationStrategy: PID 26206 died... 13:26:11.598077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Terminated: ok {rc=0} 13:26:11.642053 --- ParallelTerminationStrategy: PID 26207 died... 13:26:11.660836 run iperf3-srv_10.42.42.10(pid=26207): Terminated {rc=256} 13:26:11.705017 --- ParallelTerminationStrategy: PID 26208 died... 13:26:11.724371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Terminated: ok {rc=0} 13:26:11.768793 --- ParallelTerminationStrategy: PID 26209 died... 13:26:11.787586 run iperf3-srv_10.42.42.10(pid=26209): Terminated {rc=256} 13:26:11.832010 --- ParallelTerminationStrategy: PID 26210 died... 13:26:11.851052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26210): Terminated: ok {rc=0} 13:26:11.895293 --- ParallelTerminationStrategy: PID 26211 died... 13:26:11.914064 run iperf3-srv_10.42.42.10(pid=26211): Terminated {rc=256} 13:26:11.958108 --- ParallelTerminationStrategy: PID 26214 died... 13:26:11.976865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Terminated: ok {rc=0} 13:26:12.020697 --- ParallelTerminationStrategy: PID 26217 died... 13:26:12.039666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Terminated: ok {rc=0} 13:26:12.083586 --- ParallelTerminationStrategy: PID 26220 died... 13:26:12.102484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Terminated: ok {rc=0} 13:26:12.188385 bus /gobi_4: Setting Powered False 13:26:13.289136 bus /gobi_4: Setting Powered False 13:26:14.402436 bus /gobi_1: Setting Powered False 13:26:15.500905 bus /gobi_1: Setting Powered False 13:26:16.623895 bus /gobi_0: Setting Powered False 13:26:17.724421 bus /gobi_0: Setting Powered False 13:26:18.840659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:26:19.945951 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:19.958286 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:20.031428 tst ping.py: using LAC 34246 13:26:20.160518 tst ping.py: using RAC 76 13:26:20.286930 tst ping.py: using CellId 34246 13:26:20.411449 tst ping.py: using BVCI 34247 13:26:20.529291 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.540723 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.551979 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.563375 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.574823 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.586400 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.598039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:20.609531 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:20.727217 tst ping.py:19: start network... 13:26:20.929275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:21.396073 run create_hlr_db(pid=26222): Launched 13:26:21.520688 bus /gobi_6: Setting Powered False 13:26:22.581308 run create_hlr_db(pid=26222): Terminated: ok {rc=0} 13:26:23.002671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Launched 13:26:23.304102 run osmo-hlr_10.42.42.2(pid=26243): Launched 13:26:23.417193 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:23.938254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26246): Launched 13:26:24.238948 run osmo-stp_10.42.42.5(pid=26247): Launched 13:26:24.352887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:24.890252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26250): Launched 13:26:25.005168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:25.259722 run patchelf(pid=26251): Launched 13:26:25.428752 run osmo-stp_10.42.42.5(pid=26247): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26247)] 13:26:25.555965 run osmo-stp_10.42.42.5(pid=26247): stdout: | (launched: 2022-12-13_13:26:24.182865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:25.684881 run osmo-stp_10.42.42.5(pid=26247): stderr: | 20221213132624352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132624353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132624353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132624354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132624354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132624354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132624355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:25.813996 run osmo-stp_10.42.42.5(pid=26247): stdout: | (launched: 2022-12-13_13:26:24.182865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:25.937193 run osmo-stp_10.42.42.5(pid=26247): stderr: | 20221213132624352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132624353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132624353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132624354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132624354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132624354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132624355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:26.083065 run patchelf(pid=26251): Terminating (SIGINT) 13:26:26.251916 run patchelf(pid=26251): Terminated: ok {rc=0} 13:26:26.373591 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26247): Process ended prematurely: osmo-stp_10.42.42.5(pid=26247) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26247)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 13:26:26.382532 tst ping.py:22: Test FAILED (6.4 sec) 13:26:26.409447 run osmo-hlr_10.42.42.2(pid=26243): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26243)] 13:26:26.457322 run osmo-hlr_10.42.42.2(pid=26243): stdout: | (launched: 2022-12-13_13:26:23.248035) 13:26:26.506703 run osmo-hlr_10.42.42.2(pid=26243): stderr: | 20221213132623424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132623424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132623424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132623424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132623424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132623424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132623488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132623498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132623498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132623498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:26.556587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminating (SIGTERM) 13:26:26.596754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26246): Terminating (SIGTERM) 13:26:26.636821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26250): Terminating (SIGTERM) 13:26:26.676853 --- ParallelTerminationStrategy: PID 26224 died... 13:26:26.696365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminated: ok {rc=0} 13:26:26.740921 --- ParallelTerminationStrategy: PID 26246 died... 13:26:26.759856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26246): Terminated: ok {rc=0} 13:26:26.804014 --- ParallelTerminationStrategy: PID 26250 died... 13:26:26.822895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26250): Terminated: ok {rc=0} 13:26:26.908740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:26:27.999650 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.011985 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:28.087548 tst ping_idle_ping.py: using LAC 34247 13:26:28.208879 tst ping_idle_ping.py: using RAC 77 13:26:28.329832 tst ping_idle_ping.py: using CellId 34247 13:26:28.449628 tst ping_idle_ping.py: using BVCI 34248 13:26:28.558013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.569225 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.580159 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.591240 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.602150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.612883 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.623919 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:28.634713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:28.756500 tst ping_idle_ping.py:24: start network... 13:26:28.959852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:29.435996 run create_hlr_db(pid=26252): Launched 13:26:29.559795 bus /gobi_6: Setting Powered False 13:26:30.620149 run create_hlr_db(pid=26252): Terminated: ok {rc=0} 13:26:31.065156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Launched 13:26:31.437682 run osmo-hlr_10.42.42.2(pid=26255): Launched 13:26:31.671340 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:32.359255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Launched 13:26:32.688551 run osmo-stp_10.42.42.5(pid=26258): Launched 13:26:32.813949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:33.373318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Launched 13:26:33.498709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:33.772688 run patchelf(pid=26261): Launched 13:26:33.953828 run osmo-stp_10.42.42.5(pid=26258): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] 13:26:34.091310 run osmo-stp_10.42.42.5(pid=26258): stdout: | (launched: 2022-12-13_13:26:32.628760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:34.230811 run osmo-stp_10.42.42.5(pid=26258): stderr: | 20221213132632817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132632818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132632818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132632818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132632819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132632819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132632819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:34.370163 run osmo-stp_10.42.42.5(pid=26258): stdout: | (launched: 2022-12-13_13:26:32.628760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:34.503045 run osmo-stp_10.42.42.5(pid=26258): stderr: | 20221213132632817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132632818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132632818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132632818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132632819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132632819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132632819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:34.660173 run patchelf(pid=26261): Terminating (SIGINT) 13:26:34.842598 run patchelf(pid=26261): Terminated: ok {rc=0} 13:26:34.973990 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26258): Process ended prematurely: osmo-stp_10.42.42.5(pid=26258) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:26:34.983677 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 13:26:35.011910 run osmo-hlr_10.42.42.2(pid=26255): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26255)] 13:26:35.062791 run osmo-hlr_10.42.42.2(pid=26255): stdout: | (launched: 2022-12-13_13:26:31.372700) 13:26:35.115611 run osmo-hlr_10.42.42.2(pid=26255): stderr: | 20221213132631608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132631608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132631608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132631608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132631608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132631608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132631632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132631644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132631645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132631645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:35.168404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Terminating (SIGTERM) 13:26:35.210791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Terminating (SIGTERM) 13:26:35.253657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Terminating (SIGTERM) 13:26:35.296587 --- ParallelTerminationStrategy: PID 26254 died... 13:26:35.317363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Terminated: ok {rc=0} 13:26:35.364439 --- ParallelTerminationStrategy: PID 26257 died... 13:26:35.384551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Terminated: ok {rc=0} 13:26:35.431321 --- ParallelTerminationStrategy: PID 26260 died... 13:26:35.451481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Terminated: ok {rc=0} 13:26:35.540565 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:26:36.848515 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:36.855206 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:26:36.888549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:26:36.927074 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:26:37.014022 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:26:37.046876 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:26:37.085112 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:26:37.679426 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:26:37.729164 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:37.740109 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:26:37.810399 tst cs_paging_gprs_active.py: using LAC 34248 13:26:37.933289 tst cs_paging_gprs_active.py: using RAC 78 13:26:38.054578 tst cs_paging_gprs_active.py: using CellId 34248 13:26:38.176864 tst cs_paging_gprs_active.py: using BVCI 34249 13:26:38.299764 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.311341 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.322985 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.334524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.346731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.359076 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.371473 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.383786 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:38.396265 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:26:38.516669 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:26:38.637929 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:26:38.861206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:39.194089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26266): Launched 13:26:39.482614 run iperf3-srv_10.42.42.10(pid=26267): Launched 13:26:39.608354 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:26:39.831314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:40.163990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26268): Launched 13:26:40.453587 run iperf3-srv_10.42.42.10(pid=26269): Launched 13:26:40.579733 tst cs_paging_gprs_active.py:38: start network... 13:26:40.803037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:41.317469 run create_hlr_db(pid=26270): Launched 13:26:41.444830 bus /gobi_6: Setting Powered False 13:26:42.510030 run create_hlr_db(pid=26270): Terminated: ok {rc=0} 13:26:42.950973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Launched 13:26:43.261658 run osmo-hlr_10.42.42.2(pid=26273): Launched 13:26:43.380145 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:43.914695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Launched 13:26:44.226090 run osmo-stp_10.42.42.5(pid=26276): Launched 13:26:44.345159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:44.875837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Launched 13:26:44.994857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:45.255335 run patchelf(pid=26279): Launched 13:26:45.426050 run osmo-stp_10.42.42.5(pid=26276): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] 13:26:45.555818 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-13_13:26:44.169085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:45.687363 run osmo-stp_10.42.42.5(pid=26276): stderr: | 20221213132644336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132644336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132644336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132644337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132644337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132644337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132644337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:45.818842 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-13_13:26:44.169085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:45.970148 run osmo-stp_10.42.42.5(pid=26276): stderr: | 20221213132644336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132644336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132644336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132644337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132644337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132644337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132644337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:46.124532 run patchelf(pid=26279): Terminating (SIGINT) 13:26:46.302202 run patchelf(pid=26279): Terminated: ok {rc=0} 13:26:46.430798 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:26:46.441209 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:26:46.469375 run osmo-hlr_10.42.42.2(pid=26273): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26273)] 13:26:46.518881 run osmo-hlr_10.42.42.2(pid=26273): stdout: | (launched: 2022-12-13_13:26:43.204342) 13:26:46.569347 run osmo-hlr_10.42.42.2(pid=26273): stderr: | 20221213132643381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132643381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132643381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132643381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132643381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132643381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132643394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132643402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132643402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132643402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:46.621379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26266): Terminating (SIGTERM) 13:26:46.663422 run iperf3-srv_10.42.42.10(pid=26267): Terminating (SIGTERM) 13:26:46.707905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26268): Terminating (SIGTERM) 13:26:46.749907 run iperf3-srv_10.42.42.10(pid=26269): Terminating (SIGTERM) 13:26:46.793714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminating (SIGTERM) 13:26:46.834546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminating (SIGTERM) 13:26:46.874963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Terminating (SIGTERM) 13:26:46.915455 --- ParallelTerminationStrategy: PID 26266 died... 13:26:46.934630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26266): Terminated: ok {rc=0} 13:26:46.979180 --- ParallelTerminationStrategy: PID 26267 died... 13:26:46.998264 run iperf3-srv_10.42.42.10(pid=26267): Terminated {rc=256} 13:26:47.042599 --- ParallelTerminationStrategy: PID 26268 died... 13:26:47.061827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26268): Terminated: ok {rc=0} 13:26:47.106226 --- ParallelTerminationStrategy: PID 26269 died... 13:26:47.125221 run iperf3-srv_10.42.42.10(pid=26269): Terminated {rc=256} 13:26:47.169212 --- ParallelTerminationStrategy: PID 26272 died... 13:26:47.188046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminated: ok {rc=0} 13:26:47.232455 --- ParallelTerminationStrategy: PID 26275 died... 13:26:47.251428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminated: ok {rc=0} 13:26:47.294956 --- ParallelTerminationStrategy: PID 26278 died... 13:26:47.313455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26278): Terminated: ok {rc=0} 13:26:47.396892 bus /gobi_0: Setting Powered False 13:26:48.492533 bus /gobi_0: Setting Powered False 13:26:49.606827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:26:50.754577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:50.766229 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:26:50.839998 tst iperf3.py: using LAC 34249 13:26:50.971118 tst iperf3.py: using RAC 79 13:26:51.101765 tst iperf3.py: using CellId 34249 13:26:51.230352 tst iperf3.py: using BVCI 34250 13:26:51.350188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.361749 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.372814 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.384010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.395407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.407072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.418699 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.430460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:26:51.442147 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:26:51.559751 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:51.765141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:52.085934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Launched 13:26:52.374575 run iperf3-srv_10.42.42.10(pid=26281): Launched 13:26:52.499925 tst iperf3.py:8: start network... 13:26:52.721219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:53.230862 run create_hlr_db(pid=26282): Launched 13:26:53.356314 bus /gobi_6: Setting Powered False 13:26:54.420095 run create_hlr_db(pid=26282): Terminated: ok {rc=0} 13:26:54.875069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Launched 13:26:55.204542 run osmo-hlr_10.42.42.2(pid=26285): Launched 13:26:55.331498 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:55.903580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Launched 13:26:56.234957 run osmo-stp_10.42.42.5(pid=26288): Launched 13:26:56.362134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:56.929112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Launched 13:26:57.056568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:57.335016 run patchelf(pid=26291): Launched 13:26:57.517752 run osmo-stp_10.42.42.5(pid=26288): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] 13:26:57.656553 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-13_13:26:56.173826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:57.797588 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221213132656365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132656366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132656366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132656366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132656367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132656367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132656367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:57.939454 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-13_13:26:56.173826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:58.074215 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221213132656365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132656366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132656366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132656366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132656367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132656367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132656367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:58.234636 run patchelf(pid=26291): Terminating (SIGINT) 13:26:58.419260 run patchelf(pid=26291): Terminated: ok {rc=0} 13:26:58.552355 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 13:26:58.563430 tst iperf3.py:8: Test FAILED (7.8 sec) 13:26:58.592077 run osmo-hlr_10.42.42.2(pid=26285): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26285)] 13:26:58.643388 run osmo-hlr_10.42.42.2(pid=26285): stdout: | (launched: 2022-12-13_13:26:55.144039) 13:26:58.695677 run osmo-hlr_10.42.42.2(pid=26285): stderr: | 20221213132655341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132655341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132655341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132655341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132655341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132655341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132655357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132655366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132655367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132655367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:58.748325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminating (SIGTERM) 13:26:58.790515 run iperf3-srv_10.42.42.10(pid=26281): Terminating (SIGTERM) 13:26:58.833106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminating (SIGTERM) 13:26:58.876241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminating (SIGTERM) 13:26:58.919341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminating (SIGTERM) 13:26:58.962190 --- ParallelTerminationStrategy: PID 26280 died... 13:26:58.982717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminated: ok {rc=0} 13:26:59.029631 --- ParallelTerminationStrategy: PID 26281 died... 13:26:59.049718 run iperf3-srv_10.42.42.10(pid=26281): Terminated {rc=256} 13:26:59.096221 --- ParallelTerminationStrategy: PID 26284 died... 13:26:59.116433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminated: ok {rc=0} 13:26:59.162937 --- ParallelTerminationStrategy: PID 26287 died... 13:26:59.183166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminated: ok {rc=0} 13:26:59.229901 --- ParallelTerminationStrategy: PID 26290 died... 13:26:59.250141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminated: ok {rc=0} 13:26:59.339216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:27:00.490705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:00.502841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:00.577136 tst iperf3m4.py: using LAC 34250 13:27:00.707044 tst iperf3m4.py: using RAC 80 13:27:00.841543 tst iperf3m4.py: using CellId 34250 13:27:01.001061 tst iperf3m4.py: using BVCI 34251 13:27:01.119145 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.131203 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.143109 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.156053 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.168596 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.181101 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.193643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.205927 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:01.218764 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:01.345138 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:01.472437 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:01.611616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:01.774673 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:02.049571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:02.366319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Launched 13:27:02.636093 run iperf3-srv_10.42.42.10(pid=26293): Launched 13:27:02.752159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:27:02.959173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:03.267895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26294): Launched 13:27:03.535679 run iperf3-srv_10.42.42.10(pid=26295): Launched 13:27:03.650956 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:27:03.856146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:04.163160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26296): Launched 13:27:04.431147 run iperf3-srv_10.42.42.10(pid=26297): Launched 13:27:04.548567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:27:04.753487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:05.060714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26298): Launched 13:27:05.327357 run iperf3-srv_10.42.42.10(pid=26299): Launched 13:27:05.442499 tst iperf3m4.py:8: start network... 13:27:05.646770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:06.123969 run create_hlr_db(pid=26300): Launched 13:27:06.249620 bus /gobi_6: Setting Powered False 13:27:07.310272 run create_hlr_db(pid=26300): Terminated: ok {rc=0} 13:27:07.737321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Launched 13:27:08.044342 run osmo-hlr_10.42.42.2(pid=26303): Launched 13:27:08.160037 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:08.698166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Launched 13:27:09.003582 run osmo-stp_10.42.42.5(pid=26306): Launched 13:27:09.119814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:09.648134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Launched 13:27:09.765405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:10.023855 run patchelf(pid=26310): Launched 13:27:10.195533 run osmo-stp_10.42.42.5(pid=26306): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] 13:27:10.325780 run osmo-stp_10.42.42.5(pid=26306): stdout: | (launched: 2022-12-13_13:27:08.946554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:10.456847 run osmo-stp_10.42.42.5(pid=26306): stderr: | 20221213132709116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132709116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132709116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132709117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132709117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132709117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132709117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:10.588252 run osmo-stp_10.42.42.5(pid=26306): stdout: | (launched: 2022-12-13_13:27:08.946554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:10.713669 run osmo-stp_10.42.42.5(pid=26306): stderr: | 20221213132709116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132709116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132709116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132709117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132709117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132709117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132709117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:10.862309 run patchelf(pid=26310): Terminating (SIGINT) 13:27:11.033991 run patchelf(pid=26310): Terminated: ok {rc=0} 13:27:11.157428 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26306): Process ended prematurely: osmo-stp_10.42.42.5(pid=26306) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:27:11.166962 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:27:11.194419 run osmo-hlr_10.42.42.2(pid=26303): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26303)] 13:27:11.241504 run osmo-hlr_10.42.42.2(pid=26303): stdout: | (launched: 2022-12-13_13:27:07.987171) 13:27:11.290153 run osmo-hlr_10.42.42.2(pid=26303): stderr: | 20221213132708164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132708164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132708164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132708164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132708164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132708164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132708177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132708186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132708186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132708186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:11.339439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Terminating (SIGTERM) 13:27:11.379361 run iperf3-srv_10.42.42.10(pid=26293): Terminating (SIGTERM) 13:27:11.419954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26294): Terminating (SIGTERM) 13:27:11.460025 run iperf3-srv_10.42.42.10(pid=26295): Terminating (SIGTERM) 13:27:11.499942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26296): Terminating (SIGTERM) 13:27:11.539826 run iperf3-srv_10.42.42.10(pid=26297): Terminating (SIGTERM) 13:27:11.579664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26298): Terminating (SIGTERM) 13:27:11.619570 run iperf3-srv_10.42.42.10(pid=26299): Terminating (SIGTERM) 13:27:11.659346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Terminating (SIGTERM) 13:27:11.699508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Terminating (SIGTERM) 13:27:11.739341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Terminating (SIGTERM) 13:27:11.779405 --- ParallelTerminationStrategy: PID 26292 died... 13:27:11.798837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Terminated: ok {rc=0} 13:27:11.843239 --- ParallelTerminationStrategy: PID 26293 died... 13:27:11.862056 run iperf3-srv_10.42.42.10(pid=26293): Terminated {rc=256} 13:27:11.905942 --- ParallelTerminationStrategy: PID 26294 died... 13:27:11.924717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26294): Terminated: ok {rc=0} 13:27:11.968630 --- ParallelTerminationStrategy: PID 26295 died... 13:27:11.987399 run iperf3-srv_10.42.42.10(pid=26295): Terminated {rc=256} 13:27:12.031157 --- ParallelTerminationStrategy: PID 26296 died... 13:27:12.050022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26296): Terminated: ok {rc=0} 13:27:12.094158 --- ParallelTerminationStrategy: PID 26297 died... 13:27:12.112909 run iperf3-srv_10.42.42.10(pid=26297): Terminated {rc=256} 13:27:12.156898 --- ParallelTerminationStrategy: PID 26298 died... 13:27:12.176174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26298): Terminated: ok {rc=0} 13:27:12.220107 --- ParallelTerminationStrategy: PID 26299 died... 13:27:12.238845 run iperf3-srv_10.42.42.10(pid=26299): Terminated {rc=256} 13:27:12.282737 --- ParallelTerminationStrategy: PID 26302 died... 13:27:12.301836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Terminated: ok {rc=0} 13:27:12.346227 --- ParallelTerminationStrategy: PID 26305 died... 13:27:12.365148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Terminated: ok {rc=0} 13:27:12.408916 --- ParallelTerminationStrategy: PID 26309 died... 13:27:12.428015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Terminated: ok {rc=0} 13:27:12.511959 bus /gobi_4: Setting Powered False 13:27:13.607830 bus /gobi_4: Setting Powered False 13:27:14.724756 bus /gobi_1: Setting Powered False 13:27:15.824808 bus /gobi_1: Setting Powered False 13:27:16.959166 bus /gobi_0: Setting Powered False 13:27:18.060809 bus /gobi_0: Setting Powered False 13:27:19.178764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:27:20.282467 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.294643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:20.367955 tst ping.py: using LAC 34251 13:27:20.501450 tst ping.py: using RAC 81 13:27:20.621195 tst ping.py: using CellId 34251 13:27:20.738266 tst ping.py: using BVCI 34252 13:27:20.849121 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.860170 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.870960 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.881671 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.892384 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.903108 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.913940 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:20.924675 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:21.044572 tst ping.py:19: start network... 13:27:21.262463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:21.762269 run create_hlr_db(pid=26311): Launched 13:27:21.888165 bus /gobi_6: Setting Powered False 13:27:22.950925 run create_hlr_db(pid=26311): Terminated: ok {rc=0} 13:27:23.383481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26313): Launched 13:27:23.686050 run osmo-hlr_10.42.42.2(pid=26314): Launched 13:27:23.800280 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:24.325595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26316): Launched 13:27:24.628433 run osmo-stp_10.42.42.5(pid=26317): Launched 13:27:24.741865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:25.265414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26319): Launched 13:27:25.380145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:25.634053 run patchelf(pid=26320): Launched 13:27:25.801570 run osmo-stp_10.42.42.5(pid=26317): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26317)] 13:27:25.928724 run osmo-stp_10.42.42.5(pid=26317): stdout: | (launched: 2022-12-13_13:27:24.572087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:26.057722 run osmo-stp_10.42.42.5(pid=26317): stderr: | 20221213132724762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132724762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132724762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132724763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132724764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132724764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132724764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:26.186295 run osmo-stp_10.42.42.5(pid=26317): stdout: | (launched: 2022-12-13_13:27:24.572087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:26.308495 run osmo-stp_10.42.42.5(pid=26317): stderr: | 20221213132724762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132724762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132724762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132724763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132724764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132724764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132724764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:26.454604 run patchelf(pid=26320): Terminating (SIGINT) 13:27:26.623420 run patchelf(pid=26320): Terminated: ok {rc=0} 13:27:26.744882 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26317): Process ended prematurely: osmo-stp_10.42.42.5(pid=26317) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26317)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 13:27:26.753922 tst ping.py:22: Test FAILED (6.5 sec) 13:27:26.780375 run osmo-hlr_10.42.42.2(pid=26314): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26314)] 13:27:26.828536 run osmo-hlr_10.42.42.2(pid=26314): stdout: | (launched: 2022-12-13_13:27:23.629921) 13:27:26.877414 run osmo-hlr_10.42.42.2(pid=26314): stderr: | 20221213132723802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132723802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132723802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132723802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132723802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132723802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132723815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132723824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132723825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132723825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:26.926692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26313): Terminating (SIGTERM) 13:27:26.966204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26316): Terminating (SIGTERM) 13:27:27.005679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26319): Terminating (SIGTERM) 13:27:27.045653 --- ParallelTerminationStrategy: PID 26313 died... 13:27:27.064164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26313): Terminated: ok {rc=0} 13:27:27.108086 --- ParallelTerminationStrategy: PID 26316 died... 13:27:27.126760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26316): Terminated: ok {rc=0} 13:27:27.170392 --- ParallelTerminationStrategy: PID 26319 died... 13:27:27.189035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26319): Terminated: ok {rc=0} 13:27:27.275274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:27:28.363154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.374698 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:28.447783 tst ping_idle_ping.py: using LAC 34252 13:27:28.568348 tst ping_idle_ping.py: using RAC 82 13:27:28.689386 tst ping_idle_ping.py: using CellId 34252 13:27:28.810824 tst ping_idle_ping.py: using BVCI 34253 13:27:28.922407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.933289 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.944000 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.954888 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.965946 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.977233 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.988471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:28.999703 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:29.116141 tst ping_idle_ping.py:24: start network... 13:27:29.319443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:29.791933 run create_hlr_db(pid=26322): Launched 13:27:29.920326 bus /gobi_6: Setting Powered False 13:27:30.992210 run create_hlr_db(pid=26322): Terminated: ok {rc=0} 13:27:31.503652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26324): Launched 13:27:31.819378 run osmo-hlr_10.42.42.2(pid=26325): Launched 13:27:32.056046 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:32.712704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26327): Launched 13:27:33.039334 run osmo-stp_10.42.42.5(pid=26328): Launched 13:27:33.164118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:33.722232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26330): Launched 13:27:33.846580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:34.120781 run patchelf(pid=26331): Launched 13:27:34.302310 run osmo-stp_10.42.42.5(pid=26328): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26328)] 13:27:34.439323 run osmo-stp_10.42.42.5(pid=26328): stdout: | (launched: 2022-12-13_13:27:32.979569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:34.578728 run osmo-stp_10.42.42.5(pid=26328): stderr: | 20221213132733169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132733169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132733169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132733170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132733170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132733170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132733170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:34.717370 run osmo-stp_10.42.42.5(pid=26328): stdout: | (launched: 2022-12-13_13:27:32.979569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:34.849464 run osmo-stp_10.42.42.5(pid=26328): stderr: | 20221213132733169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132733169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132733169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132733170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132733170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132733170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132733170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:35.007159 run patchelf(pid=26331): Terminating (SIGINT) 13:27:35.189181 run patchelf(pid=26331): Terminated: ok {rc=0} 13:27:35.320259 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26328): Process ended prematurely: osmo-stp_10.42.42.5(pid=26328) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26328)] [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:27:35.330018 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 13:27:35.358076 run osmo-hlr_10.42.42.2(pid=26325): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26325)] 13:27:35.408743 run osmo-hlr_10.42.42.2(pid=26325): stdout: | (launched: 2022-12-13_13:27:31.761797) 13:27:35.460485 run osmo-hlr_10.42.42.2(pid=26325): stderr: | 20221213132732096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132732096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132732096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132732096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132732096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132732096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132732119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132732127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132732127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132732127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:35.512594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26324): Terminating (SIGTERM) 13:27:35.554766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26327): Terminating (SIGTERM) 13:27:35.596884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26330): Terminating (SIGTERM) 13:27:35.639598 --- ParallelTerminationStrategy: PID 26324 died... 13:27:35.659783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26324): Terminated: ok {rc=0} 13:27:35.706139 --- ParallelTerminationStrategy: PID 26327 died... 13:27:35.725929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26327): Terminated: ok {rc=0} 13:27:35.772388 --- ParallelTerminationStrategy: PID 26330 died... 13:27:35.792423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26330): Terminated: ok {rc=0} 13:27:35.881803 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:27:37.189717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:37.196717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:27:37.231429 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:27:37.272232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:27:37.362185 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:27:37.395834 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:27:37.435571 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:27:38.033598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:27:38.084125 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.095679 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:27:38.148922 tst cs_paging_gprs_active.py: using LAC 34253 13:27:38.272715 tst cs_paging_gprs_active.py: using RAC 83 13:27:38.396281 tst cs_paging_gprs_active.py: using CellId 34253 13:27:38.519711 tst cs_paging_gprs_active.py: using BVCI 34254 13:27:38.634954 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.646383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.657493 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.668562 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.680199 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.691795 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.703533 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.715047 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:38.726757 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:27:38.849721 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:27:38.969119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:27:39.177495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:39.489173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26338): Launched 13:27:39.759933 run iperf3-srv_10.42.42.10(pid=26339): Launched 13:27:39.878339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:27:40.085519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:40.396561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26340): Launched 13:27:40.667551 run iperf3-srv_10.42.42.10(pid=26341): Launched 13:27:40.783138 tst cs_paging_gprs_active.py:38: start network... 13:27:40.990015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:41.469117 run create_hlr_db(pid=26342): Launched 13:27:41.594760 bus /gobi_6: Setting Powered False 13:27:42.655698 run create_hlr_db(pid=26342): Terminated: ok {rc=0} 13:27:43.105245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26344): Launched 13:27:43.434746 run osmo-hlr_10.42.42.2(pid=26345): Launched 13:27:43.562960 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:44.132457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26347): Launched 13:27:44.463809 run osmo-stp_10.42.42.5(pid=26348): Launched 13:27:44.591116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:45.160037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26350): Launched 13:27:45.287466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:45.566739 run patchelf(pid=26351): Launched 13:27:45.750206 run osmo-stp_10.42.42.5(pid=26348): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26348)] 13:27:45.902726 run osmo-stp_10.42.42.5(pid=26348): stdout: | (launched: 2022-12-13_13:27:44.403237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:46.049803 run osmo-stp_10.42.42.5(pid=26348): stderr: | 20221213132744595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132744595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132744595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132744596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132744596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132744596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132744596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:46.187641 run osmo-stp_10.42.42.5(pid=26348): stdout: | (launched: 2022-12-13_13:27:44.403237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:46.319875 run osmo-stp_10.42.42.5(pid=26348): stderr: | 20221213132744595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132744595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132744595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132744596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132744596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132744596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132744596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:46.477249 run patchelf(pid=26351): Terminating (SIGINT) 13:27:46.658604 run patchelf(pid=26351): Terminated: ok {rc=0} 13:27:46.790988 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26348): Process ended prematurely: osmo-stp_10.42.42.5(pid=26348) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26348)] [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:27:46.802014 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:27:46.830639 run osmo-hlr_10.42.42.2(pid=26345): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26345)] 13:27:46.881989 run osmo-hlr_10.42.42.2(pid=26345): stdout: | (launched: 2022-12-13_13:27:43.374231) 13:27:46.934951 run osmo-hlr_10.42.42.2(pid=26345): stderr: | 20221213132743570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132743570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132743570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132743570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132743570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132743570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132743582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132743591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132743591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132743591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:46.989729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26338): Terminating (SIGTERM) 13:27:47.034201 run iperf3-srv_10.42.42.10(pid=26339): Terminating (SIGTERM) 13:27:47.079574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26340): Terminating (SIGTERM) 13:27:47.122712 run iperf3-srv_10.42.42.10(pid=26341): Terminating (SIGTERM) 13:27:47.167757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26344): Terminating (SIGTERM) 13:27:47.211044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26347): Terminating (SIGTERM) 13:27:47.253066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26350): Terminating (SIGTERM) 13:27:47.295130 --- ParallelTerminationStrategy: PID 26338 died... 13:27:47.315163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26338): Terminated: ok {rc=0} 13:27:47.361316 --- ParallelTerminationStrategy: PID 26339 died... 13:27:47.380874 run iperf3-srv_10.42.42.10(pid=26339): Terminated {rc=256} 13:27:47.426971 --- ParallelTerminationStrategy: PID 26340 died... 13:27:47.446879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26340): Terminated: ok {rc=0} 13:27:47.493065 --- ParallelTerminationStrategy: PID 26341 died... 13:27:47.512795 run iperf3-srv_10.42.42.10(pid=26341): Terminated {rc=256} 13:27:47.558951 --- ParallelTerminationStrategy: PID 26344 died... 13:27:47.578848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26344): Terminated: ok {rc=0} 13:27:47.625110 --- ParallelTerminationStrategy: PID 26347 died... 13:27:47.644885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26347): Terminated: ok {rc=0} 13:27:47.691175 --- ParallelTerminationStrategy: PID 26350 died... 13:27:47.711152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26350): Terminated: ok {rc=0} 13:27:47.799607 bus /gobi_0: Setting Powered False 13:27:48.898144 bus /gobi_0: Setting Powered False 13:27:50.014175 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:27:51.165125 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.177771 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:27:51.235560 tst iperf3.py: using LAC 34254 13:27:51.366258 tst iperf3.py: using RAC 84 13:27:51.497191 tst iperf3.py: using CellId 34254 13:27:51.627802 tst iperf3.py: using BVCI 34255 13:27:51.750010 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.761822 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.773552 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.785135 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.797021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.808778 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.820910 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.832742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:27:51.844903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:27:51.965649 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:52.173548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:52.483477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26352): Launched 13:27:52.754884 run iperf3-srv_10.42.42.10(pid=26353): Launched 13:27:52.873105 tst iperf3.py:8: start network... 13:27:53.079025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:53.555985 run create_hlr_db(pid=26354): Launched 13:27:53.685133 bus /gobi_6: Setting Powered False 13:27:54.750161 run create_hlr_db(pid=26354): Terminated: ok {rc=0} 13:27:55.189377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26356): Launched 13:27:55.495723 run osmo-hlr_10.42.42.2(pid=26357): Launched 13:27:55.610363 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:56.151235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26359): Launched 13:27:56.456812 run osmo-stp_10.42.42.5(pid=26360): Launched 13:27:56.572570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:57.096856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26362): Launched 13:27:57.213274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:57.469528 run patchelf(pid=26363): Launched 13:27:57.638859 run osmo-stp_10.42.42.5(pid=26360): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26360)] 13:27:57.767322 run osmo-stp_10.42.42.5(pid=26360): stdout: | (launched: 2022-12-13_13:27:56.400409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:57.897753 run osmo-stp_10.42.42.5(pid=26360): stderr: | 20221213132756568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132756568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132756568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132756569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132756569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132756569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132756570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:58.028220 run osmo-stp_10.42.42.5(pid=26360): stdout: | (launched: 2022-12-13_13:27:56.400409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:58.152766 run osmo-stp_10.42.42.5(pid=26360): stderr: | 20221213132756568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132756568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132756568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132756569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132756569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132756569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132756570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:58.300590 run patchelf(pid=26363): Terminating (SIGINT) 13:27:58.472333 run patchelf(pid=26363): Terminated: ok {rc=0} 13:27:58.595816 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26360): Process ended prematurely: osmo-stp_10.42.42.5(pid=26360) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26360)] [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:27:58.605493 tst iperf3.py:8: Test FAILED (7.5 sec) 13:27:58.632154 run osmo-hlr_10.42.42.2(pid=26357): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26357)] 13:27:58.679749 run osmo-hlr_10.42.42.2(pid=26357): stdout: | (launched: 2022-12-13_13:27:55.439168) 13:27:58.728393 run osmo-hlr_10.42.42.2(pid=26357): stderr: | 20221213132755615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132755615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132755615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132755615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132755615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132755615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132755628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132755638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132755638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132755638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:58.777461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26352): Terminating (SIGTERM) 13:27:58.816586 run iperf3-srv_10.42.42.10(pid=26353): Terminating (SIGTERM) 13:27:58.855641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26356): Terminating (SIGTERM) 13:27:58.895389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26359): Terminating (SIGTERM) 13:27:58.934671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26362): Terminating (SIGTERM) 13:27:58.974085 --- ParallelTerminationStrategy: PID 26352 died... 13:27:58.992817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26352): Terminated: ok {rc=0} 13:27:59.036310 --- ParallelTerminationStrategy: PID 26353 died... 13:27:59.054567 run iperf3-srv_10.42.42.10(pid=26353): Terminated {rc=256} 13:27:59.097976 --- ParallelTerminationStrategy: PID 26356 died... 13:27:59.116413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26356): Terminated: ok {rc=0} 13:27:59.160350 --- ParallelTerminationStrategy: PID 26359 died... 13:27:59.178907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26359): Terminated: ok {rc=0} 13:27:59.222213 --- ParallelTerminationStrategy: PID 26362 died... 13:27:59.240525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26362): Terminated: ok {rc=0} 13:27:59.326042 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:28:00.470735 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:00.482640 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:28:00.536023 tst iperf3m4.py: using LAC 34255 13:28:00.659638 tst iperf3m4.py: using RAC 85 13:28:00.777517 tst iperf3m4.py: using CellId 34255 13:28:00.923741 tst iperf3m4.py: using BVCI 34256 13:28:01.036597 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.049086 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.061152 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.073434 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.085716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.097526 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.109297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.120749 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:01.132637 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:01.273691 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:01.434277 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:01.559923 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:01.693510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:28:01.946702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:02.282218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26364): Launched 13:28:02.578185 run iperf3-srv_10.42.42.10(pid=26365): Launched 13:28:02.702911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:28:02.923703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:03.250859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26366): Launched 13:28:03.535384 run iperf3-srv_10.42.42.10(pid=26367): Launched 13:28:03.659636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:28:03.879330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:04.207009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26368): Launched 13:28:04.492342 run iperf3-srv_10.42.42.10(pid=26369): Launched 13:28:04.616413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:28:04.836482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:05.164588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26370): Launched 13:28:05.450328 run iperf3-srv_10.42.42.10(pid=26371): Launched 13:28:05.574980 tst iperf3m4.py:8: start network... 13:28:05.794508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:06.299559 run create_hlr_db(pid=26372): Launched 13:28:06.425692 bus /gobi_6: Setting Powered False 13:28:07.489792 run create_hlr_db(pid=26372): Terminated: ok {rc=0} 13:28:07.923528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Launched 13:28:08.226915 run osmo-hlr_10.42.42.2(pid=26375): Launched 13:28:08.344502 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:08.887203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Launched 13:28:09.190735 run osmo-stp_10.42.42.5(pid=26378): Launched 13:28:09.307403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:09.830944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26380): Launched 13:28:09.948497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:10.204926 run patchelf(pid=26381): Launched 13:28:10.373369 run osmo-stp_10.42.42.5(pid=26378): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] 13:28:10.501145 run osmo-stp_10.42.42.5(pid=26378): stdout: | (launched: 2022-12-13_13:28:09.134215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:10.630135 run osmo-stp_10.42.42.5(pid=26378): stderr: | 20221213132809300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132809300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132809300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132809301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132809301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132809301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132809301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:10.759731 run osmo-stp_10.42.42.5(pid=26378): stdout: | (launched: 2022-12-13_13:28:09.134215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:10.883861 run osmo-stp_10.42.42.5(pid=26378): stderr: | 20221213132809300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132809300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132809300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132809301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132809301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132809301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132809301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:11.030664 run patchelf(pid=26381): Terminating (SIGINT) 13:28:11.201350 run patchelf(pid=26381): Terminated: ok {rc=0} 13:28:11.323666 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26378): Process ended prematurely: osmo-stp_10.42.42.5(pid=26378) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:28:11.333480 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:28:11.360376 run osmo-hlr_10.42.42.2(pid=26375): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26375)] 13:28:11.407487 run osmo-hlr_10.42.42.2(pid=26375): stdout: | (launched: 2022-12-13_13:28:08.170450) 13:28:11.456272 run osmo-hlr_10.42.42.2(pid=26375): stderr: | 20221213132808342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132808342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132808342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132808342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132808342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132808342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132808354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132808363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132808363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132808363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:11.505302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26364): Terminating (SIGTERM) 13:28:11.544742 run iperf3-srv_10.42.42.10(pid=26365): Terminating (SIGTERM) 13:28:11.584152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26366): Terminating (SIGTERM) 13:28:11.623478 run iperf3-srv_10.42.42.10(pid=26367): Terminating (SIGTERM) 13:28:11.664376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26368): Terminating (SIGTERM) 13:28:11.704192 run iperf3-srv_10.42.42.10(pid=26369): Terminating (SIGTERM) 13:28:11.743618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26370): Terminating (SIGTERM) 13:28:11.783068 run iperf3-srv_10.42.42.10(pid=26371): Terminating (SIGTERM) 13:28:11.822269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Terminating (SIGTERM) 13:28:11.861499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Terminating (SIGTERM) 13:28:11.901373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26380): Terminating (SIGTERM) 13:28:11.940865 --- ParallelTerminationStrategy: PID 26364 died... 13:28:11.959947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26364): Terminated: ok {rc=0} 13:28:12.003843 --- ParallelTerminationStrategy: PID 26365 died... 13:28:12.022402 run iperf3-srv_10.42.42.10(pid=26365): Terminated {rc=256} 13:28:12.065689 --- ParallelTerminationStrategy: PID 26366 died... 13:28:12.084253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26366): Terminated: ok {rc=0} 13:28:12.127681 --- ParallelTerminationStrategy: PID 26367 died... 13:28:12.146320 run iperf3-srv_10.42.42.10(pid=26367): Terminated {rc=256} 13:28:12.189575 --- ParallelTerminationStrategy: PID 26368 died... 13:28:12.208126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26368): Terminated: ok {rc=0} 13:28:12.251421 --- ParallelTerminationStrategy: PID 26369 died... 13:28:12.269939 run iperf3-srv_10.42.42.10(pid=26369): Terminated {rc=256} 13:28:12.313248 --- ParallelTerminationStrategy: PID 26370 died... 13:28:12.331818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26370): Terminated: ok {rc=0} 13:28:12.375113 --- ParallelTerminationStrategy: PID 26371 died... 13:28:12.393567 run iperf3-srv_10.42.42.10(pid=26371): Terminated {rc=256} 13:28:12.436713 --- ParallelTerminationStrategy: PID 26374 died... 13:28:12.455371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26374): Terminated: ok {rc=0} 13:28:12.498709 --- ParallelTerminationStrategy: PID 26377 died... 13:28:12.517380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26377): Terminated: ok {rc=0} 13:28:12.560435 --- ParallelTerminationStrategy: PID 26380 died... 13:28:12.579133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26380): Terminated: ok {rc=0} 13:28:12.663871 bus /gobi_4: Setting Powered False 13:28:13.762332 bus /gobi_4: Setting Powered False 13:28:14.878462 bus /gobi_1: Setting Powered False 13:28:15.981691 bus /gobi_1: Setting Powered False 13:28:17.106689 bus /gobi_0: Setting Powered False 13:28:18.217109 bus /gobi_0: Setting Powered False 13:28:19.332187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:28:20.435221 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:20.447141 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:28:20.499718 tst ping.py: using LAC 34256 13:28:20.627753 tst ping.py: using RAC 86 13:28:20.753277 tst ping.py: using CellId 34256 13:28:20.879518 tst ping.py: using BVCI 34257 13:28:20.987638 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:20.999113 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.010594 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.022209 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.033825 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.045065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.056335 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:21.067607 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:21.188662 tst ping.py:19: start network... 13:28:21.403012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:21.896422 run create_hlr_db(pid=26382): Launched 13:28:22.022827 bus /gobi_6: Setting Powered False 13:28:23.085783 run create_hlr_db(pid=26382): Terminated: ok {rc=0} 13:28:23.513240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26384): Launched 13:28:23.810988 run osmo-hlr_10.42.42.2(pid=26385): Launched 13:28:23.923122 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:24.450099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26387): Launched 13:28:24.747724 run osmo-stp_10.42.42.5(pid=26388): Launched 13:28:24.860251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:25.375023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26390): Launched 13:28:25.490136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:25.750667 run patchelf(pid=26391): Launched 13:28:25.915192 run osmo-stp_10.42.42.5(pid=26388): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26388)] 13:28:26.040635 run osmo-stp_10.42.42.5(pid=26388): stdout: | (launched: 2022-12-13_13:28:24.692244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:26.167928 run osmo-stp_10.42.42.5(pid=26388): stderr: | 20221213132824858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132824859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132824859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132824859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132824860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132824860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132824860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:26.295352 run osmo-stp_10.42.42.5(pid=26388): stdout: | (launched: 2022-12-13_13:28:24.692244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:26.416486 run osmo-stp_10.42.42.5(pid=26388): stderr: | 20221213132824858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132824859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132824859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132824859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132824860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132824860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132824860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:26.560129 run patchelf(pid=26391): Terminating (SIGINT) 13:28:26.727375 run patchelf(pid=26391): Terminated: ok {rc=0} 13:28:26.847787 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26388): Process ended prematurely: osmo-stp_10.42.42.5(pid=26388) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26388)] [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:28:26.856729 tst ping.py:22: Test FAILED (6.4 sec) 13:28:26.883250 run osmo-hlr_10.42.42.2(pid=26385): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26385)] 13:28:26.931274 run osmo-hlr_10.42.42.2(pid=26385): stdout: | (launched: 2022-12-13_13:28:23.755786) 13:28:26.979689 run osmo-hlr_10.42.42.2(pid=26385): stderr: | 20221213132823928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132823928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132823928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132823928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132823928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132823928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132823941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132823950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132823950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132823950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:27.028708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26384): Terminating (SIGTERM) 13:28:27.068000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26387): Terminating (SIGTERM) 13:28:27.107186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26390): Terminating (SIGTERM) 13:28:27.146675 --- ParallelTerminationStrategy: PID 26384 died... 13:28:27.165700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26384): Terminated: ok {rc=0} 13:28:27.209059 --- ParallelTerminationStrategy: PID 26387 died... 13:28:27.227605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26387): Terminated: ok {rc=0} 13:28:27.271362 --- ParallelTerminationStrategy: PID 26390 died... 13:28:27.290223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26390): Terminated: ok {rc=0} 13:28:27.375749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:28:28.464119 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:28.475959 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:28:28.530271 tst ping_idle_ping.py: using LAC 34257 13:28:28.651835 tst ping_idle_ping.py: using RAC 87 13:28:28.769277 tst ping_idle_ping.py: using CellId 34257 13:28:28.890263 tst ping_idle_ping.py: using BVCI 34258 13:28:29.001676 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.013065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.024141 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.035234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.046847 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.058634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.070464 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:28:29.082084 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:28:29.198636 tst ping_idle_ping.py:24: start network... 13:28:29.398584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:29.864086 run create_hlr_db(pid=26392): Launched 13:28:29.985238 bus /gobi_6: Setting Powered False 13:28:31.047743 run create_hlr_db(pid=26392): Terminated: ok {rc=0} 13:28:31.512915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26394): Launched 13:28:31.857890 run osmo-hlr_10.42.42.2(pid=26395): Launched 13:28:32.038671 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:32.604111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26397): Launched 13:28:32.928566 run osmo-stp_10.42.42.5(pid=26398): Launched 13:28:33.051340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:33.604340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26400): Launched 13:28:33.728682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:33.999646 run patchelf(pid=26401): Launched 13:28:34.178937 run osmo-stp_10.42.42.5(pid=26398): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26398)] 13:28:34.314311 run osmo-stp_10.42.42.5(pid=26398): stdout: | (launched: 2022-12-13_13:28:32.868697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:34.451667 run osmo-stp_10.42.42.5(pid=26398): stderr: | 20221213132833058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132833058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132833058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132833059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132833059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132833059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132833059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:34.589675 run osmo-stp_10.42.42.5(pid=26398): stdout: | (launched: 2022-12-13_13:28:32.868697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:34.720806 run osmo-stp_10.42.42.5(pid=26398): stderr: | 20221213132833058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132833058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132833058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132833059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132833059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132833059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132833059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:34.875645 run patchelf(pid=26401): Terminating (SIGINT) 13:28:35.056035 run patchelf(pid=26401): Terminated: ok {rc=0} 13:28:35.185409 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26398): Process ended prematurely: osmo-stp_10.42.42.5(pid=26398) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26398)] [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:28:35.195151 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:28:35.223046 run osmo-hlr_10.42.42.2(pid=26395): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26395)] 13:28:35.273182 run osmo-hlr_10.42.42.2(pid=26395): stdout: | (launched: 2022-12-13_13:28:31.798134) 13:28:35.324797 run osmo-hlr_10.42.42.2(pid=26395): stderr: | 20221213132832147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132832147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132832147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132832147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132832148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132832148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132832165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132832174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132832175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132832175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:35.376671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26394): Terminating (SIGTERM) 13:28:35.418555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26397): Terminating (SIGTERM) 13:28:35.460430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26400): Terminating (SIGTERM) 13:28:35.502911 --- ParallelTerminationStrategy: PID 26394 died... 13:28:35.523287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26394): Terminated: ok {rc=0} 13:28:35.569468 --- ParallelTerminationStrategy: PID 26397 died... 13:28:35.589331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26397): Terminated: ok {rc=0} 13:28:35.635298 --- ParallelTerminationStrategy: PID 26400 died... 13:28:35.655092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26400): Terminated: ok {rc=0} 13:28:35.742936 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:28:37.058918 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:37.067159 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:28:37.100079 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:28:37.135059 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:28:37.187698 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:28:37.220490 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:28:37.256174 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:28:37.813446 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:28:37.818656 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:37.830142 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:28:37.910506 tst switch_tch_pdch.py: using LAC 34258 13:28:38.034354 tst switch_tch_pdch.py: using RAC 88 13:28:38.157700 tst switch_tch_pdch.py: using CellId 34258 13:28:38.274435 tst switch_tch_pdch.py: using BVCI 34259 13:28:38.382012 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.393152 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.404125 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.415094 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.426621 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.438148 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.449937 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:38.461427 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:38.583239 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:38.700932 tst switch_tch_pdch.py:51: start network... 13:28:38.916572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:39.410380 run create_hlr_db(pid=26405): Launched 13:28:39.532228 bus /gobi_6: Setting Powered False 13:28:40.595571 run create_hlr_db(pid=26405): Terminated: ok {rc=0} 13:28:41.022750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Launched 13:28:41.320905 run osmo-hlr_10.42.42.2(pid=26408): Launched 13:28:41.435790 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:41.947157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Launched 13:28:42.244596 run osmo-stp_10.42.42.5(pid=26411): Launched 13:28:42.357963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:42.870721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Launched 13:28:42.984650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:43.236360 run patchelf(pid=26414): Launched 13:28:43.410806 run osmo-stp_10.42.42.5(pid=26411): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] 13:28:43.546924 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-13_13:28:42.190047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:43.684365 run osmo-stp_10.42.42.5(pid=26411): stderr: | 20221213132842355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132842355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132842355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132842355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132842356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132842356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132842356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:43.821764 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-13_13:28:42.190047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:43.953231 run osmo-stp_10.42.42.5(pid=26411): stderr: | 20221213132842355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132842355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132842355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132842355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132842356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132842356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132842356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:44.108703 run patchelf(pid=26414): Terminating (SIGINT) 13:28:44.288208 run patchelf(pid=26414): Terminated: ok {rc=0} 13:28:44.417606 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:28:44.427168 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:28:44.455346 run osmo-hlr_10.42.42.2(pid=26408): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26408)] 13:28:44.506107 run osmo-hlr_10.42.42.2(pid=26408): stdout: | (launched: 2022-12-13_13:28:41.266496) 13:28:44.558151 run osmo-hlr_10.42.42.2(pid=26408): stderr: | 20221213132841437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132841437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132841437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132841437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132841438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132841438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132841450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132841461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132841461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132841461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:44.610182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminating (SIGTERM) 13:28:44.652414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminating (SIGTERM) 13:28:44.694629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Terminating (SIGTERM) 13:28:44.737301 --- ParallelTerminationStrategy: PID 26407 died... 13:28:44.757758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminated: ok {rc=0} 13:28:44.804566 --- ParallelTerminationStrategy: PID 26410 died... 13:28:44.824579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminated: ok {rc=0} 13:28:44.871021 --- ParallelTerminationStrategy: PID 26413 died... 13:28:44.891258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Terminated: ok {rc=0} 13:28:44.979462 bus /gobi_0: Setting Powered False 13:28:46.076670 bus /gobi_0: Setting Powered False 13:28:47.195054 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:28:48.448276 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:48.454455 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:28:48.487367 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:28:48.522407 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:28:48.574732 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:28:48.607340 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:28:48.641494 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:28:49.201837 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:28:49.207074 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.218452 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:28:49.290195 tst switch_tch_pdch.py: using LAC 34259 13:28:49.415622 tst switch_tch_pdch.py: using RAC 89 13:28:49.540226 tst switch_tch_pdch.py: using CellId 34259 13:28:49.665312 tst switch_tch_pdch.py: using BVCI 34260 13:28:49.774052 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.785178 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.795900 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.806902 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.817912 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.829034 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.840102 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:49.850976 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:28:49.970574 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:28:50.091913 tst switch_tch_pdch.py:51: start network... 13:28:50.291447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:50.726024 run create_hlr_db(pid=26418): Launched 13:28:50.850166 bus /gobi_6: Setting Powered False 13:28:51.909950 run create_hlr_db(pid=26418): Terminated: ok {rc=0} 13:28:52.318668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26420): Launched 13:28:52.637199 run osmo-hlr_10.42.42.2(pid=26421): Launched 13:28:52.759568 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:53.280116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26423): Launched 13:28:53.598543 run osmo-stp_10.42.42.5(pid=26424): Launched 13:28:53.720621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:54.241886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26426): Launched 13:28:54.363936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:54.632613 run patchelf(pid=26427): Launched 13:28:54.810825 run osmo-stp_10.42.42.5(pid=26424): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26424)] 13:28:54.946281 run osmo-stp_10.42.42.5(pid=26424): stdout: | (launched: 2022-12-13_13:28:53.540548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:55.083372 run osmo-stp_10.42.42.5(pid=26424): stderr: | 20221213132853726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132853726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132853726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132853727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132853727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132853727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132853727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:55.220378 run osmo-stp_10.42.42.5(pid=26424): stdout: | (launched: 2022-12-13_13:28:53.540548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:55.351186 run osmo-stp_10.42.42.5(pid=26424): stderr: | 20221213132853726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132853726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132853726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132853727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132853727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132853727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132853727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:55.505602 run patchelf(pid=26427): Terminating (SIGINT) 13:28:55.684385 run patchelf(pid=26427): Terminated: ok {rc=0} 13:28:55.813247 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26424): Process ended prematurely: osmo-stp_10.42.42.5(pid=26424) [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26424)] [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:28:55.822906 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:28:55.850835 run osmo-hlr_10.42.42.2(pid=26421): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26421)] 13:28:55.901835 run osmo-hlr_10.42.42.2(pid=26421): stdout: | (launched: 2022-12-13_13:28:52.579303) 13:28:55.953599 run osmo-hlr_10.42.42.2(pid=26421): stderr: | 20221213132852770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132852770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132852770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132852770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132852770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132852770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132852782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132852791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132852792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132852792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:56.005492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26420): Terminating (SIGTERM) 13:28:56.047225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26423): Terminating (SIGTERM) 13:28:56.089085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26426): Terminating (SIGTERM) 13:28:56.131099 --- ParallelTerminationStrategy: PID 26420 died... 13:28:56.151202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26420): Terminated: ok {rc=0} 13:28:56.197252 --- ParallelTerminationStrategy: PID 26423 died... 13:28:56.216867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26423): Terminated: ok {rc=0} 13:28:56.262730 --- ParallelTerminationStrategy: PID 26426 died... 13:28:56.282368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26426): Terminated: ok {rc=0} 13:28:56.369740 bus /gobi_0: Setting Powered False 13:28:57.468415 bus /gobi_0: Setting Powered False 13:28:58.580671 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:28:59.831007 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:59.835003 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:28:59.867981 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:28:59.875079 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:28:59.927658 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:28:59.962516 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:28:59.969733 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:29:00.504908 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:29:00.510078 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:29:00.520901 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:29:00.570315 tst mo_mt_sms.py: using LAC 34260 13:29:00.687073 tst mo_mt_sms.py: using RAC 90 13:29:00.805542 tst mo_mt_sms.py: using CellId 34260 13:29:00.963257 tst mo_mt_sms.py: using BVCI 34261 13:29:01.085871 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:29:01.211929 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:29:01.344369 tst mo_mt_sms.py:9: start nitb and bts... 13:29:01.550550 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:29:02.174855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26431): Launched 13:29:02.481398 run osmo-nitb_10.42.42.2(pid=26432): Launched 13:29:02.646005 run osmo-nitb_10.42.42.2(pid=26432): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26432)] 13:29:02.779422 run osmo-nitb_10.42.42.2(pid=26432): stdout: | (launched: 2022-12-13_13:29:02.426841) 13:29:02.914099 run osmo-nitb_10.42.42.2(pid=26432): stderr: | (launched: 2022-12-13_13:29:02.471124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:03.048705 run osmo-nitb_10.42.42.2(pid=26432): stdout: | (launched: 2022-12-13_13:29:02.426841) 13:29:03.177504 run osmo-nitb_10.42.42.2(pid=26432): stderr: | (launched: 2022-12-13_13:29:02.471124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26432) [trial-2390↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26432)] 13:29:03.593211 tst osmo-nitb_10.42.42.2(pid=26432): stdout: | (launched: 2022-12-13_13:29:02.426841) 13:29:03.712677 tst osmo-nitb_10.42.42.2(pid=26432): stderr: | (launched: 2022-12-13_13:29:02.471124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:03.853237 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26432) [trial-2390↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26432)] [trial-2390↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 13:29:03.861768 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:29:03.868322 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26431): Terminating (SIGTERM) 13:29:04.076514 --- ParallelTerminationStrategy: PID 26431 died... 13:29:04.097308 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26431): Terminated: ok {rc=0} 13:29:04.183733 bus /sierra_3: Setting Powered False 13:29:05.283991 bus /sierra_3: Setting Powered False 13:29:06.400644 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:29:07.601855 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:07.605722 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:29:07.638761 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:29:07.665085 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:29:07.714668 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:29:07.747755 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:29:07.774060 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:29:08.323958 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:29:08.329138 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.339842 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:29:08.387289 tst mo_mt_sms.py: using LAC 34261 13:29:08.502258 tst mo_mt_sms.py: using RAC 91 13:29:08.619604 tst mo_mt_sms.py: using CellId 34261 13:29:08.734540 tst mo_mt_sms.py: using BVCI 34262 13:29:08.843114 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.853783 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.864302 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.874751 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.885162 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:08.895498 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:29:09.010343 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:29:09.130074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:09.624731 run create_hlr_db(pid=26439): Launched 13:29:09.747616 bus /sierra_2: Setting Powered False 13:29:10.807063 run create_hlr_db(pid=26439): Terminated: ok {rc=0} 13:29:11.235107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Launched 13:29:11.531736 run osmo-hlr_10.42.42.2(pid=26442): Launched 13:29:11.643592 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:12.155521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Launched 13:29:12.451800 run osmo-stp_10.42.42.5(pid=26445): Launched 13:29:12.566242 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:13.103432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26447): Launched 13:29:13.401105 run osmo-msc_10.42.42.6(pid=26448): Launched 13:29:13.565892 run osmo-stp_10.42.42.5(pid=26445): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] 13:29:13.690438 run osmo-stp_10.42.42.5(pid=26445): stdout: | (launched: 2022-12-13_13:29:12.397078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:13.816079 run osmo-stp_10.42.42.5(pid=26445): stderr: | 20221213132912564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132912564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132912564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132912565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132912565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132912566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132912566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:13.939473 run osmo-stp_10.42.42.5(pid=26445): stdout: | (launched: 2022-12-13_13:29:12.397078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:14.056850 run osmo-stp_10.42.42.5(pid=26445): stderr: | 20221213132912564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132912564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132912564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132912565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132912565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132912566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132912566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:14.197313 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26445): Process ended prematurely: osmo-stp_10.42.42.5(pid=26445) [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 13:29:14.205502 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:29:14.231371 run osmo-hlr_10.42.42.2(pid=26442): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26442)] 13:29:14.278984 run osmo-hlr_10.42.42.2(pid=26442): stdout: | (launched: 2022-12-13_13:29:11.477159) 13:29:14.328094 run osmo-hlr_10.42.42.2(pid=26442): stderr: | 20221213132911649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132911649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132911649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132911649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132911649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132911649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132911661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132911670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132911671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132911671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:14.396645 run osmo-msc_10.42.42.6(pid=26448): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26448)] 13:29:14.443872 run osmo-msc_10.42.42.6(pid=26448): stdout: | (launched: 2022-12-13_13:29:13.345787) 13:29:14.492482 run osmo-msc_10.42.42.6(pid=26448): stderr: | 20221213132913615 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132913615 DLGLOBAL DEBUG validating counter group 0x7f2698b5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132913616 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132913616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132913616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132913616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132913618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132913618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132913618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132913618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:14.541497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Terminating (SIGTERM) 13:29:14.580703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Terminating (SIGTERM) 13:29:14.619952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26447): Terminating (SIGTERM) 13:29:14.659357 --- ParallelTerminationStrategy: PID 26441 died... 13:29:14.678326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Terminated: ok {rc=0} 13:29:14.721841 --- ParallelTerminationStrategy: PID 26444 died... 13:29:14.740105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Terminated: ok {rc=0} 13:29:14.783385 --- ParallelTerminationStrategy: PID 26447 died... 13:29:14.801772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26447): Terminated: ok {rc=0} 13:29:14.883799 bus /sierra_3: Setting Powered False 13:29:15.994563 bus /sierra_3: Setting Powered False 13:29:17.112795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:29:18.340206 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:18.344255 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:29:18.377508 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:29:18.384228 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:29:18.419696 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:29:18.453169 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:29:18.459713 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:29:18.979677 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:29:18.984441 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:29:18.995225 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:29:19.047004 tst assert_extension.py: using LAC 34262 13:29:19.163977 tst assert_extension.py: using RAC 92 13:29:19.280101 tst assert_extension.py: using CellId 34262 13:29:19.395922 tst assert_extension.py: using BVCI 34263 13:29:19.502911 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:29:19.621620 tst assert_extension.py:10: start nitb and bts... 13:29:19.836201 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:29:20.486389 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26453): Launched 13:29:20.806786 run osmo-nitb_10.42.42.2(pid=26454): Launched 13:29:20.983667 run osmo-nitb_10.42.42.2(pid=26454): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26454)] 13:29:21.127044 run osmo-nitb_10.42.42.2(pid=26454): stdout: | (launched: 2022-12-13_13:29:20.748244) 13:29:21.271554 run osmo-nitb_10.42.42.2(pid=26454): stderr: | (launched: 2022-12-13_13:29:20.795684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:21.415920 run osmo-nitb_10.42.42.2(pid=26454): stdout: | (launched: 2022-12-13_13:29:20.748244) 13:29:21.555025 run osmo-nitb_10.42.42.2(pid=26454): stderr: | (launched: 2022-12-13_13:29:20.795684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26454) [trial-2390↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26454)] 13:29:21.927851 tst osmo-nitb_10.42.42.2(pid=26454): stdout: | (launched: 2022-12-13_13:29:20.748244) 13:29:22.057244 tst osmo-nitb_10.42.42.2(pid=26454): stderr: | (launched: 2022-12-13_13:29:20.795684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:22.209680 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26454) [trial-2390↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26454)] [trial-2390↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 13:29:22.219058 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:29:22.226213 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26453): Terminating (SIGTERM) 13:29:22.438677 --- ParallelTerminationStrategy: PID 26453 died... 13:29:22.460544 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26453): Terminated: ok {rc=0} 13:29:22.549889 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:29:23.730689 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:23.735396 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:29:23.768993 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:29:23.795960 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:29:23.830702 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:29:23.864058 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:29:23.890558 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:29:24.422766 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:29:24.427934 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:24.438831 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:29:24.487238 tst assert_extension.py: using LAC 34263 13:29:24.604670 tst assert_extension.py: using RAC 93 13:29:24.721340 tst assert_extension.py: using CellId 34263 13:29:24.837398 tst assert_extension.py: using BVCI 34264 13:29:24.955566 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:24.966420 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:24.977039 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:24.987486 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:24.997952 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:29:25.008320 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:29:25.122554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:25.582743 run create_hlr_db(pid=26458): Launched 13:29:25.704189 bus /sierra_2: Setting Powered False 13:29:26.763675 run create_hlr_db(pid=26458): Terminated: ok {rc=0} 13:29:27.199651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26460): Launched 13:29:27.518959 run osmo-hlr_10.42.42.2(pid=26461): Launched 13:29:27.642250 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:28.284212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26463): Launched 13:29:28.598981 run osmo-stp_10.42.42.5(pid=26464): Launched 13:29:28.718756 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:29.293521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26466): Launched 13:29:29.609703 run osmo-msc_10.42.42.6(pid=26468): Launched 13:29:29.785813 run osmo-stp_10.42.42.5(pid=26464): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26464)] 13:29:29.924031 run osmo-stp_10.42.42.5(pid=26464): stdout: | (launched: 2022-12-13_13:29:28.541641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:30.059451 run osmo-stp_10.42.42.5(pid=26464): stderr: | 20221213132928726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132928726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132928726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132928727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132928727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132928727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132928727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:30.191356 run osmo-stp_10.42.42.5(pid=26464): stdout: | (launched: 2022-12-13_13:29:28.541641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:30.316716 run osmo-stp_10.42.42.5(pid=26464): stderr: | 20221213132928726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132928726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132928726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132928727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132928727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132928727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132928727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:30.467422 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26464): Process ended prematurely: osmo-stp_10.42.42.5(pid=26464) [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26464)] [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py:17] 13:29:30.476318 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:29:30.503373 run osmo-hlr_10.42.42.2(pid=26461): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26461)] 13:29:30.553555 run osmo-hlr_10.42.42.2(pid=26461): stdout: | (launched: 2022-12-13_13:29:27.460746) 13:29:30.604882 run osmo-hlr_10.42.42.2(pid=26461): stderr: | 20221213132927653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132927653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132927653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132927653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132927653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132927653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132927664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132927673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132927673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132927674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:30.676727 run osmo-msc_10.42.42.6(pid=26468): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26468)] 13:29:30.726070 run osmo-msc_10.42.42.6(pid=26468): stdout: | (launched: 2022-12-13_13:29:29.551650) 13:29:30.777392 run osmo-msc_10.42.42.6(pid=26468): stderr: | 20221213132929867 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132929867 DLGLOBAL DEBUG validating counter group 0x7f9958916c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132929867 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132929867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132929868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132929868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132929869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132929870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132929870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132929870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:30.832138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26460): Terminating (SIGTERM) 13:29:30.906852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26463): Terminating (SIGTERM) 13:29:30.960727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26466): Terminating (SIGTERM) 13:29:31.006102 --- ParallelTerminationStrategy: PID 26460 died... 13:29:31.027535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26460): Terminated: ok {rc=0} 13:29:31.075751 --- ParallelTerminationStrategy: PID 26463 died... 13:29:31.096543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26463): Terminated: ok {rc=0} 13:29:31.144092 --- ParallelTerminationStrategy: PID 26466 died... 13:29:31.165138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26466): Terminated: ok {rc=0} 13:29:31.255091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:29:32.465057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:32.471949 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:29:32.505454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:29:32.532548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:29:32.583238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:29:32.616160 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:29:32.642792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:29:33.195897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:29:33.245606 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.256794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:29:33.327567 tst mo_mt_call.py: using LAC 34264 13:29:33.448154 tst mo_mt_call.py: using RAC 94 13:29:33.567722 tst mo_mt_call.py: using CellId 34264 13:29:33.687544 tst mo_mt_call.py: using BVCI 34265 13:29:33.798014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.809190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.819972 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.830899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.841931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:33.852766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:33.968904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:34.088362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:34.587545 run create_hlr_db(pid=26473): Launched 13:29:34.711690 bus /sierra_2: Setting Powered False 13:29:35.771325 run create_hlr_db(pid=26473): Terminated: ok {rc=0} 13:29:36.200570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Launched 13:29:36.501250 run osmo-hlr_10.42.42.2(pid=26476): Launched 13:29:36.615972 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:37.130687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Launched 13:29:37.429062 run osmo-stp_10.42.42.5(pid=26479): Launched 13:29:37.544495 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:38.088623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Launched 13:29:38.390108 run osmo-msc_10.42.42.6(pid=26482): Launched 13:29:38.557877 run osmo-stp_10.42.42.5(pid=26479): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] 13:29:38.684407 run osmo-stp_10.42.42.5(pid=26479): stdout: | (launched: 2022-12-13_13:29:37.374014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:38.811368 run osmo-stp_10.42.42.5(pid=26479): stderr: | 20221213132937540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132937540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132937541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132937541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132937542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132937542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132937542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:38.935988 run osmo-stp_10.42.42.5(pid=26479): stdout: | (launched: 2022-12-13_13:29:37.374014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:39.054455 run osmo-stp_10.42.42.5(pid=26479): stderr: | 20221213132937540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132937540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132937541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132937541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132937542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132937542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132937542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:39.196374 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26479): Process ended prematurely: osmo-stp_10.42.42.5(pid=26479) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:29:39.205555 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:29:39.231679 run osmo-hlr_10.42.42.2(pid=26476): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26476)] 13:29:39.279481 run osmo-hlr_10.42.42.2(pid=26476): stdout: | (launched: 2022-12-13_13:29:36.445892) 13:29:39.328559 run osmo-hlr_10.42.42.2(pid=26476): stderr: | 20221213132936618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132936619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132936619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132936619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132936619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132936619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132936632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132936641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132936641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132936641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:39.396715 run osmo-msc_10.42.42.6(pid=26482): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26482)] 13:29:39.443794 run osmo-msc_10.42.42.6(pid=26482): stdout: | (launched: 2022-12-13_13:29:38.334893) 13:29:39.492753 run osmo-msc_10.42.42.6(pid=26482): stderr: | 20221213132938604 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132938604 DLGLOBAL DEBUG validating counter group 0x7fa5089bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132938604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132938604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132938605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132938605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132938607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132938607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132938607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132938607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:39.542028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Terminating (SIGTERM) 13:29:39.581324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Terminating (SIGTERM) 13:29:39.620608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Terminating (SIGTERM) 13:29:39.660035 --- ParallelTerminationStrategy: PID 26475 died... 13:29:39.678988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Terminated: ok {rc=0} 13:29:39.722397 --- ParallelTerminationStrategy: PID 26478 died... 13:29:39.740756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Terminated: ok {rc=0} 13:29:39.783930 --- ParallelTerminationStrategy: PID 26481 died... 13:29:39.802416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Terminated: ok {rc=0} 13:29:39.885370 bus /sierra_3: Setting Powered False 13:29:40.982582 bus /sierra_3: Setting Powered False 13:29:42.101873 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:29:43.247551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.259295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:29:43.332341 tst mo_mt_call_osmux.py: using LAC 34265 13:29:43.449391 tst mo_mt_call_osmux.py: using RAC 95 13:29:43.572656 tst mo_mt_call_osmux.py: using CellId 34265 13:29:43.690091 tst mo_mt_call_osmux.py: using BVCI 34266 13:29:43.799488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.810614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.821661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.832532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.843602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:43.855065 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:43.976758 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:44.095387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:44.559507 run create_hlr_db(pid=26484): Launched 13:29:44.681987 bus /sierra_2: Setting Powered False 13:29:45.741928 run create_hlr_db(pid=26484): Terminated: ok {rc=0} 13:29:46.196428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Launched 13:29:46.547368 run osmo-hlr_10.42.42.2(pid=26487): Launched 13:29:46.794081 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:47.395834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Launched 13:29:47.718951 run osmo-stp_10.42.42.5(pid=26490): Launched 13:29:47.841254 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:48.421376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Launched 13:29:48.742263 run osmo-msc_10.42.42.6(pid=26493): Launched 13:29:48.920808 run osmo-stp_10.42.42.5(pid=26490): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] 13:29:49.056366 run osmo-stp_10.42.42.5(pid=26490): stdout: | (launched: 2022-12-13_13:29:47.659878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:49.192702 run osmo-stp_10.42.42.5(pid=26490): stderr: | 20221213132947846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132947846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132947847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132947847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132947847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132947847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132947848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:49.327033 run osmo-stp_10.42.42.5(pid=26490): stdout: | (launched: 2022-12-13_13:29:47.659878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:49.454432 run osmo-stp_10.42.42.5(pid=26490): stderr: | 20221213132947846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132947846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132947847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132947847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132947847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132947847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132947848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:49.607112 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26490): Process ended prematurely: osmo-stp_10.42.42.5(pid=26490) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:29:49.616584 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:29:49.643823 run osmo-hlr_10.42.42.2(pid=26487): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26487)] 13:29:49.693822 run osmo-hlr_10.42.42.2(pid=26487): stdout: | (launched: 2022-12-13_13:29:46.484036) 13:29:49.745142 run osmo-hlr_10.42.42.2(pid=26487): stderr: | 20221213132946791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132946791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132946791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132946791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132946791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132946791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132946814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132946830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132946830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132946831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:49.816932 run osmo-msc_10.42.42.6(pid=26493): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26493)] 13:29:49.865861 run osmo-msc_10.42.42.6(pid=26493): stdout: | (launched: 2022-12-13_13:29:48.683170) 13:29:49.916843 run osmo-msc_10.42.42.6(pid=26493): stderr: | 20221213132949000 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213132949000 DLGLOBAL DEBUG validating counter group 0x7f78e5491c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213132949001 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213132949001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213132949001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213132949001 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213132949003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213132949003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213132949003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213132949003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:49.968505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Terminating (SIGTERM) 13:29:50.009900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Terminating (SIGTERM) 13:29:50.051257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Terminating (SIGTERM) 13:29:50.093041 --- ParallelTerminationStrategy: PID 26486 died... 13:29:50.112928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Terminated: ok {rc=0} 13:29:50.158644 --- ParallelTerminationStrategy: PID 26489 died... 13:29:50.178127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Terminated: ok {rc=0} 13:29:50.223476 --- ParallelTerminationStrategy: PID 26492 died... 13:29:50.242921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Terminated: ok {rc=0} 13:29:50.330178 bus /sierra_3: Setting Powered False 13:29:51.427094 bus /sierra_3: Setting Powered False 13:29:52.540512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:29:53.795637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:53.804169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:29:53.839177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:29:53.866790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:29:53.917405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:29:53.951805 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:29:53.979485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:29:54.534707 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:29:54.586532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.598342 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:29:54.669054 tst mo_mt_call.py: using LAC 34266 13:29:54.795089 tst mo_mt_call.py: using RAC 96 13:29:54.921168 tst mo_mt_call.py: using CellId 34266 13:29:55.044942 tst mo_mt_call.py: using BVCI 34267 13:29:55.161948 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:55.173763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:55.185522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:55.197222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:55.209290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:55.221244 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:55.338367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:55.453159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:55.917492 run create_hlr_db(pid=26498): Launched 13:29:56.040798 bus /sierra_2: Setting Powered False 13:29:57.101111 run create_hlr_db(pid=26498): Terminated: ok {rc=0} 13:29:57.538809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Launched 13:29:57.862029 run osmo-hlr_10.42.42.2(pid=26501): Launched 13:29:57.984596 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:58.542292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Launched 13:29:58.862411 run osmo-stp_10.42.42.5(pid=26504): Launched 13:29:58.984231 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:59.567075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Launched 13:29:59.889559 run osmo-msc_10.42.42.6(pid=26507): Launched 13:30:00.071319 run osmo-stp_10.42.42.5(pid=26504): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] 13:30:00.207535 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-13_13:29:58.803654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:00.344837 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221213132958991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132958991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132958991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132958992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132958992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132958992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132958992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:00.480024 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-13_13:29:58.803654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:00.608320 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221213132958991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213132958991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213132958991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213132958992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213132958992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213132958992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213132958992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:00.761895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:30:00.771464 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:30:00.798901 run osmo-hlr_10.42.42.2(pid=26501): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26501)] 13:30:00.862456 run osmo-hlr_10.42.42.2(pid=26501): stdout: | (launched: 2022-12-13_13:29:57.803002) 13:30:00.923921 run osmo-hlr_10.42.42.2(pid=26501): stderr: | 20221213132957997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213132957997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213132957997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213132957997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213132957997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213132957997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213132958010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213132958019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213132958019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213132958019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:00.997386 run osmo-msc_10.42.42.6(pid=26507): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26507)] 13:30:01.047572 run osmo-msc_10.42.42.6(pid=26507): stdout: | (launched: 2022-12-13_13:29:59.830763) 13:30:01.100919 run osmo-msc_10.42.42.6(pid=26507): stderr: | 20221213133000150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133000150 DLGLOBAL DEBUG validating counter group 0x7ff7a9053c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133000151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133000151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133000151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133000151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133000153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133000153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133000153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133000153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:01.153712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminating (SIGTERM) 13:30:01.196875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminating (SIGTERM) 13:30:01.241636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Terminating (SIGTERM) 13:30:01.285837 --- ParallelTerminationStrategy: PID 26500 died... 13:30:01.307424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminated: ok {rc=0} 13:30:01.356243 --- ParallelTerminationStrategy: PID 26503 died... 13:30:01.377487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminated: ok {rc=0} 13:30:01.425192 --- ParallelTerminationStrategy: PID 26506 died... 13:30:01.446561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Terminated: ok {rc=0} 13:30:01.537944 bus /sierra_3: Setting Powered False 13:30:02.646742 bus /sierra_3: Setting Powered False 13:30:03.761196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:30:04.909210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:04.921621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:30:04.996510 tst mo_mt_call_osmux.py: using LAC 34267 13:30:05.117358 tst mo_mt_call_osmux.py: using RAC 97 13:30:05.245268 tst mo_mt_call_osmux.py: using CellId 34267 13:30:05.372544 tst mo_mt_call_osmux.py: using BVCI 34268 13:30:05.489717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:05.501628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:05.513330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:05.524788 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:05.536685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:30:05.548519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:30:05.663728 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:30:05.785379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:06.282799 run create_hlr_db(pid=26512): Launched 13:30:06.406067 bus /sierra_2: Setting Powered False 13:30:07.470139 run create_hlr_db(pid=26512): Terminated: ok {rc=0} 13:30:07.898996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26514): Launched 13:30:08.198438 run osmo-hlr_10.42.42.2(pid=26515): Launched 13:30:08.314674 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:08.831497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26517): Launched 13:30:09.131511 run osmo-stp_10.42.42.5(pid=26518): Launched 13:30:09.244342 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:09.787209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26520): Launched 13:30:10.088351 run osmo-msc_10.42.42.6(pid=26521): Launched 13:30:10.255698 run osmo-stp_10.42.42.5(pid=26518): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26518)] 13:30:10.383186 run osmo-stp_10.42.42.5(pid=26518): stdout: | (launched: 2022-12-13_13:30:09.076172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:10.510826 run osmo-stp_10.42.42.5(pid=26518): stderr: | 20221213133009243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133009243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133009243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133009244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133009244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133009244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133009244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:10.636112 run osmo-stp_10.42.42.5(pid=26518): stdout: | (launched: 2022-12-13_13:30:09.076172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:10.754992 run osmo-stp_10.42.42.5(pid=26518): stderr: | 20221213133009243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133009243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133009243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133009244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133009244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133009244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133009244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:10.897656 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26518): Process ended prematurely: osmo-stp_10.42.42.5(pid=26518) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26518)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:30:10.906623 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:30:10.932347 run osmo-hlr_10.42.42.2(pid=26515): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26515)] 13:30:10.979228 run osmo-hlr_10.42.42.2(pid=26515): stdout: | (launched: 2022-12-13_13:30:08.143396) 13:30:11.027909 run osmo-hlr_10.42.42.2(pid=26515): stderr: | 20221213133008316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133008316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133008316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133008316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133008316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133008316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133008332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133008343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133008343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133008343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:11.095921 run osmo-msc_10.42.42.6(pid=26521): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26521)] 13:30:11.142812 run osmo-msc_10.42.42.6(pid=26521): stdout: | (launched: 2022-12-13_13:30:10.032883) 13:30:11.191222 run osmo-msc_10.42.42.6(pid=26521): stderr: | 20221213133010302 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133010302 DLGLOBAL DEBUG validating counter group 0x7fede78aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133010302 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133010302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133010303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133010303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133010304 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133010305 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133010305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133010305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:11.240202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26514): Terminating (SIGTERM) 13:30:11.279291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26517): Terminating (SIGTERM) 13:30:11.318538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26520): Terminating (SIGTERM) 13:30:11.357932 --- ParallelTerminationStrategy: PID 26514 died... 13:30:11.376689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26514): Terminated: ok {rc=0} 13:30:11.419847 --- ParallelTerminationStrategy: PID 26517 died... 13:30:11.438176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26517): Terminated: ok {rc=0} 13:30:11.481242 --- ParallelTerminationStrategy: PID 26520 died... 13:30:11.499576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26520): Terminated: ok {rc=0} 13:30:11.584059 bus /sierra_3: Setting Powered False 13:30:12.682875 bus /sierra_3: Setting Powered False 13:30:13.794714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:30:15.044478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:15.051046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:30:15.083880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:30:15.110037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:30:15.160477 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:30:15.194374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:30:15.220930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:30:15.773555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:30:15.822138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.833706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:30:15.921011 tst mo_mt_call.py: using LAC 34268 13:30:16.041778 tst mo_mt_call.py: using RAC 98 13:30:16.199092 tst mo_mt_call.py: using CellId 34268 13:30:16.354306 tst mo_mt_call.py: using BVCI 34269 13:30:16.469072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:16.481733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:16.494093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:16.506439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:16.519224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:16.531984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:16.650008 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:16.795139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:17.270936 run create_hlr_db(pid=26526): Launched 13:30:17.425691 bus /sierra_2: Setting Powered False 13:30:18.488642 run create_hlr_db(pid=26526): Terminated: ok {rc=0} 13:30:18.918887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26528): Launched 13:30:19.220168 run osmo-hlr_10.42.42.2(pid=26529): Launched 13:30:19.333539 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:19.863487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26531): Launched 13:30:20.164118 run osmo-stp_10.42.42.5(pid=26532): Launched 13:30:20.277299 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:20.820058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26534): Launched 13:30:21.122364 run osmo-msc_10.42.42.6(pid=26535): Launched 13:30:21.292142 run osmo-stp_10.42.42.5(pid=26532): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26532)] 13:30:21.418985 run osmo-stp_10.42.42.5(pid=26532): stdout: | (launched: 2022-12-13_13:30:20.108454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:21.546529 run osmo-stp_10.42.42.5(pid=26532): stderr: | 20221213133020277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133020278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133020278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133020278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133020279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133020279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133020279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:21.671987 run osmo-stp_10.42.42.5(pid=26532): stdout: | (launched: 2022-12-13_13:30:20.108454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:21.791355 run osmo-stp_10.42.42.5(pid=26532): stderr: | 20221213133020277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133020278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133020278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133020278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133020279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133020279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133020279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:21.935270 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26532): Process ended prematurely: osmo-stp_10.42.42.5(pid=26532) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26532)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:30:21.944392 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:30:21.970471 run osmo-hlr_10.42.42.2(pid=26529): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26529)] 13:30:22.018011 run osmo-hlr_10.42.42.2(pid=26529): stdout: | (launched: 2022-12-13_13:30:19.164687) 13:30:22.067073 run osmo-hlr_10.42.42.2(pid=26529): stderr: | 20221213133019338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133019338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133019338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133019338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133019338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133019338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133019350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133019361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133019361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133019361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:22.135302 run osmo-msc_10.42.42.6(pid=26535): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26535)] 13:30:22.182267 run osmo-msc_10.42.42.6(pid=26535): stdout: | (launched: 2022-12-13_13:30:21.066772) 13:30:22.230974 run osmo-msc_10.42.42.6(pid=26535): stderr: | 20221213133021335 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133021335 DLGLOBAL DEBUG validating counter group 0x7f9f021cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133021335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133021335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133021336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133021336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133021337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133021338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133021338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133021338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:22.279756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26528): Terminating (SIGTERM) 13:30:22.319175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26531): Terminating (SIGTERM) 13:30:22.358548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26534): Terminating (SIGTERM) 13:30:22.398120 --- ParallelTerminationStrategy: PID 26528 died... 13:30:22.417178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26528): Terminated: ok {rc=0} 13:30:22.460608 --- ParallelTerminationStrategy: PID 26531 died... 13:30:22.479110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26531): Terminated: ok {rc=0} 13:30:22.522073 --- ParallelTerminationStrategy: PID 26534 died... 13:30:22.540390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26534): Terminated: ok {rc=0} 13:30:22.625614 bus /sierra_3: Setting Powered False 13:30:23.723372 bus /sierra_3: Setting Powered False 13:30:24.838069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:30:25.983564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:25.995553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:30:26.064860 tst mo_mt_call_osmux.py: using LAC 34269 13:30:26.193392 tst mo_mt_call_osmux.py: using RAC 99 13:30:26.321361 tst mo_mt_call_osmux.py: using CellId 34269 13:30:26.448655 tst mo_mt_call_osmux.py: using BVCI 34270 13:30:26.566146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:26.578100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:26.589998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:26.601595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:26.613487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:26.625269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:26.742035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:26.864080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:27.364752 run create_hlr_db(pid=26537): Launched 13:30:27.489649 bus /sierra_2: Setting Powered False 13:30:28.548748 run create_hlr_db(pid=26537): Terminated: ok {rc=0} 13:30:29.000015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26539): Launched 13:30:29.323459 run osmo-hlr_10.42.42.2(pid=26540): Launched 13:30:29.446344 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:30.000112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26542): Launched 13:30:30.321988 run osmo-stp_10.42.42.5(pid=26543): Launched 13:30:30.445162 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:31.051722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26545): Launched 13:30:31.446858 run osmo-msc_10.42.42.6(pid=26546): Launched 13:30:31.808648 run osmo-stp_10.42.42.5(pid=26543): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26543)] 13:30:32.051786 run osmo-stp_10.42.42.5(pid=26543): stdout: | (launched: 2022-12-13_13:30:30.263534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:32.240690 run osmo-stp_10.42.42.5(pid=26543): stderr: | 20221213133030450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133030450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133030450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133030451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133030451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133030451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133030451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:32.367648 run osmo-stp_10.42.42.5(pid=26543): stdout: | (launched: 2022-12-13_13:30:30.263534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:32.486857 run osmo-stp_10.42.42.5(pid=26543): stderr: | 20221213133030450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133030450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133030450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133030451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133030451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133030451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133030451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:32.630098 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26543): Process ended prematurely: osmo-stp_10.42.42.5(pid=26543) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26543)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:30:32.639011 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:30:32.665140 run osmo-hlr_10.42.42.2(pid=26540): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26540)] 13:30:32.712556 run osmo-hlr_10.42.42.2(pid=26540): stdout: | (launched: 2022-12-13_13:30:29.264185) 13:30:32.761309 run osmo-hlr_10.42.42.2(pid=26540): stderr: | 20221213133029457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133029457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133029457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133029457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133029457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133029457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133029469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133029480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133029480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133029480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:32.829230 run osmo-msc_10.42.42.6(pid=26546): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26546)] 13:30:32.876518 run osmo-msc_10.42.42.6(pid=26546): stdout: | (launched: 2022-12-13_13:30:31.387719) 13:30:32.925073 run osmo-msc_10.42.42.6(pid=26546): stderr: | 20221213133031872 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133031881 DLGLOBAL DEBUG validating counter group 0x7fcad683ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133031889 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133031889 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133031889 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133031889 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133031891 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133031892 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133031892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133031892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:32.973949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26539): Terminating (SIGTERM) 13:30:33.013132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26542): Terminating (SIGTERM) 13:30:33.052372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26545): Terminating (SIGTERM) 13:30:33.091923 --- ParallelTerminationStrategy: PID 26539 died... 13:30:33.110881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26539): Terminated: ok {rc=0} 13:30:33.154180 --- ParallelTerminationStrategy: PID 26542 died... 13:30:33.172457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26542): Terminated: ok {rc=0} 13:30:33.215583 --- ParallelTerminationStrategy: PID 26545 died... 13:30:33.233908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26545): Terminated: ok {rc=0} 13:30:33.318901 bus /sierra_3: Setting Powered False 13:30:34.414583 bus /sierra_3: Setting Powered False 13:30:35.528222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:30:36.778708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:36.785378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:30:36.818449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:30:36.845031 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:30:36.896288 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:30:36.929789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:30:36.957197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:30:37.513044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:30:37.561850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.572838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:30:37.643543 tst mo_mt_call.py: using LAC 34270 13:30:37.761617 tst mo_mt_call.py: using RAC 100 13:30:37.879992 tst mo_mt_call.py: using CellId 34270 13:30:37.998684 tst mo_mt_call.py: using BVCI 34271 13:30:38.108146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:38.119314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:38.130362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:38.141342 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:38.152855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:38.164493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:38.285973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:38.402666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:38.866958 run create_hlr_db(pid=26551): Launched 13:30:38.990755 bus /sierra_2: Setting Powered False 13:30:40.050380 run create_hlr_db(pid=26551): Terminated: ok {rc=0} 13:30:40.488901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26553): Launched 13:30:40.809879 run osmo-hlr_10.42.42.2(pid=26554): Launched 13:30:40.931913 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:41.490723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26556): Launched 13:30:41.813410 run osmo-stp_10.42.42.5(pid=26557): Launched 13:30:41.936889 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:42.522357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26559): Launched 13:30:42.846191 run osmo-msc_10.42.42.6(pid=26560): Launched 13:30:43.027653 run osmo-stp_10.42.42.5(pid=26557): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26557)] 13:30:43.168896 run osmo-stp_10.42.42.5(pid=26557): stdout: | (launched: 2022-12-13_13:30:41.754478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:43.303178 run osmo-stp_10.42.42.5(pid=26557): stderr: | 20221213133041941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133041941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133041942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133041942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133041942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133041943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133041943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:43.438740 run osmo-stp_10.42.42.5(pid=26557): stdout: | (launched: 2022-12-13_13:30:41.754478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:43.567950 run osmo-stp_10.42.42.5(pid=26557): stderr: | 20221213133041941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133041941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133041942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133041942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133041942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133041943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133041943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:43.722181 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26557): Process ended prematurely: osmo-stp_10.42.42.5(pid=26557) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26557)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:30:43.731774 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:30:43.759285 run osmo-hlr_10.42.42.2(pid=26554): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26554)] 13:30:43.810004 run osmo-hlr_10.42.42.2(pid=26554): stdout: | (launched: 2022-12-13_13:30:40.751432) 13:30:43.861264 run osmo-hlr_10.42.42.2(pid=26554): stderr: | 20221213133040943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133040944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133040944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133040944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133040944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133040944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133040957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133040966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133040967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133040967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:43.933412 run osmo-msc_10.42.42.6(pid=26560): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26560)] 13:30:43.983303 run osmo-msc_10.42.42.6(pid=26560): stdout: | (launched: 2022-12-13_13:30:42.786920) 13:30:44.034798 run osmo-msc_10.42.42.6(pid=26560): stderr: | 20221213133043106 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133043106 DLGLOBAL DEBUG validating counter group 0x7f0afda7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133043106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133043106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133043106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133043107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133043108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133043109 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133043109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133043109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:44.086530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26553): Terminating (SIGTERM) 13:30:44.127729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26556): Terminating (SIGTERM) 13:30:44.169345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26559): Terminating (SIGTERM) 13:30:44.211811 --- ParallelTerminationStrategy: PID 26553 died... 13:30:44.232124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26553): Terminated: ok {rc=0} 13:30:44.278148 --- ParallelTerminationStrategy: PID 26556 died... 13:30:44.297873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26556): Terminated: ok {rc=0} 13:30:44.343818 --- ParallelTerminationStrategy: PID 26559 died... 13:30:44.363628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26559): Terminated: ok {rc=0} 13:30:44.450297 bus /sierra_3: Setting Powered False 13:30:45.546911 bus /sierra_3: Setting Powered False 13:30:46.674521 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:30:47.832130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:47.843871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:30:47.918777 tst mo_mt_call_osmux.py: using LAC 34271 13:30:48.036093 tst mo_mt_call_osmux.py: using RAC 101 13:30:48.152639 tst mo_mt_call_osmux.py: using CellId 34271 13:30:48.269844 tst mo_mt_call_osmux.py: using BVCI 34272 13:30:48.379040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:48.390292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:48.401223 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:48.412246 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:48.423237 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:48.434247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:48.550710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:48.671376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:49.172755 run create_hlr_db(pid=26562): Launched 13:30:49.297987 bus /sierra_2: Setting Powered False 13:30:50.362191 run create_hlr_db(pid=26562): Terminated: ok {rc=0} 13:30:50.791905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Launched 13:30:51.093597 run osmo-hlr_10.42.42.2(pid=26565): Launched 13:30:51.208205 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:51.735315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Launched 13:30:52.056807 run osmo-stp_10.42.42.5(pid=26570): Launched 13:30:52.180887 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:52.765349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26572): Launched 13:30:53.089717 run osmo-msc_10.42.42.6(pid=26573): Launched 13:30:53.268527 run osmo-stp_10.42.42.5(pid=26570): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26570)] 13:30:53.404695 run osmo-stp_10.42.42.5(pid=26570): stdout: | (launched: 2022-12-13_13:30:51.997358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:53.541488 run osmo-stp_10.42.42.5(pid=26570): stderr: | 20221213133052184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133052184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133052185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133052185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133052186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133052186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133052186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:53.676900 run osmo-stp_10.42.42.5(pid=26570): stdout: | (launched: 2022-12-13_13:30:51.997358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:53.804480 run osmo-stp_10.42.42.5(pid=26570): stderr: | 20221213133052184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133052184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133052185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133052185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133052186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133052186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133052186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:53.957912 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26570): Process ended prematurely: osmo-stp_10.42.42.5(pid=26570) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26570)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:30:53.967618 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:30:53.995074 run osmo-hlr_10.42.42.2(pid=26565): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26565)] 13:30:54.045431 run osmo-hlr_10.42.42.2(pid=26565): stdout: | (launched: 2022-12-13_13:30:51.038336) 13:30:54.097452 run osmo-hlr_10.42.42.2(pid=26565): stderr: | 20221213133051211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133051211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133051211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133051211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133051211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133051211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133051224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133051232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133051233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133051233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:54.169415 run osmo-msc_10.42.42.6(pid=26573): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26573)] 13:30:54.218834 run osmo-msc_10.42.42.6(pid=26573): stdout: | (launched: 2022-12-13_13:30:53.030272) 13:30:54.269996 run osmo-msc_10.42.42.6(pid=26573): stderr: | 20221213133053347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133053348 DLGLOBAL DEBUG validating counter group 0x7f5b73620c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133053348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133053348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133053348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133053348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133053350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133053350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133053351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133053351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:54.321671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Terminating (SIGTERM) 13:30:54.363202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Terminating (SIGTERM) 13:30:54.404802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26572): Terminating (SIGTERM) 13:30:54.446577 --- ParallelTerminationStrategy: PID 26564 died... 13:30:54.466634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Terminated: ok {rc=0} 13:30:54.512396 --- ParallelTerminationStrategy: PID 26567 died... 13:30:54.531996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Terminated: ok {rc=0} 13:30:54.578023 --- ParallelTerminationStrategy: PID 26572 died... 13:30:54.597944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26572): Terminated: ok {rc=0} 13:30:54.685910 bus /sierra_3: Setting Powered False 13:30:55.784090 bus /sierra_3: Setting Powered False 13:30:56.899179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:30:58.151650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:58.158895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:30:58.194306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:30:58.222610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:30:58.275500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:30:58.309505 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:30:58.336476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:30:58.887125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:30:58.936530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.947914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:30:59.018245 tst mo_mt_call.py: using LAC 34272 13:30:59.141941 tst mo_mt_call.py: using RAC 102 13:30:59.259860 tst mo_mt_call.py: using CellId 34272 13:30:59.377140 tst mo_mt_call.py: using BVCI 34273 13:30:59.486254 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:59.497430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:59.508265 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:59.519302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:59.530644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:59.541857 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:59.661804 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:59.779616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:00.281072 run create_hlr_db(pid=26578): Launched 13:31:00.405812 bus /sierra_2: Setting Powered False 13:31:01.486058 run create_hlr_db(pid=26578): Terminated: ok {rc=0} 13:31:01.924250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26580): Launched 13:31:02.236660 run osmo-hlr_10.42.42.2(pid=26581): Launched 13:31:02.352171 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:02.884113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26583): Launched 13:31:03.183991 run osmo-stp_10.42.42.5(pid=26584): Launched 13:31:03.297254 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:03.840046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26586): Launched 13:31:04.142371 run osmo-msc_10.42.42.6(pid=26587): Launched 13:31:04.311805 run osmo-stp_10.42.42.5(pid=26584): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26584)] 13:31:04.439643 run osmo-stp_10.42.42.5(pid=26584): stdout: | (launched: 2022-12-13_13:31:03.128692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:04.568093 run osmo-stp_10.42.42.5(pid=26584): stderr: | 20221213133103296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133103296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133103296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133103297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133103297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133103297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133103297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:04.694720 run osmo-stp_10.42.42.5(pid=26584): stdout: | (launched: 2022-12-13_13:31:03.128692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:04.814750 run osmo-stp_10.42.42.5(pid=26584): stderr: | 20221213133103296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133103296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133103296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133103297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133103297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133103297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133103297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:04.959444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26584): Process ended prematurely: osmo-stp_10.42.42.5(pid=26584) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26584)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:31:04.968470 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:31:04.994695 run osmo-hlr_10.42.42.2(pid=26581): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26581)] 13:31:05.042067 run osmo-hlr_10.42.42.2(pid=26581): stdout: | (launched: 2022-12-13_13:31:02.181091) 13:31:05.090767 run osmo-hlr_10.42.42.2(pid=26581): stderr: | 20221213133102351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133102352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133102352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133102352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133102352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133102352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133102364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133102376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133102376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133102376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:05.158901 run osmo-msc_10.42.42.6(pid=26587): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26587)] 13:31:05.205843 run osmo-msc_10.42.42.6(pid=26587): stdout: | (launched: 2022-12-13_13:31:04.086364) 13:31:05.254245 run osmo-msc_10.42.42.6(pid=26587): stderr: | 20221213133104355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133104355 DLGLOBAL DEBUG validating counter group 0x7f710c66dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133104355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133104355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133104355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133104355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133104357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133104358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133104358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133104358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:05.303042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26580): Terminating (SIGTERM) 13:31:05.342266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26583): Terminating (SIGTERM) 13:31:05.381442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26586): Terminating (SIGTERM) 13:31:05.421091 --- ParallelTerminationStrategy: PID 26580 died... 13:31:05.440095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26580): Terminated: ok {rc=0} 13:31:05.483541 --- ParallelTerminationStrategy: PID 26583 died... 13:31:05.501898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26583): Terminated: ok {rc=0} 13:31:05.545138 --- ParallelTerminationStrategy: PID 26586 died... 13:31:05.563558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26586): Terminated: ok {rc=0} 13:31:05.648521 bus /sierra_3: Setting Powered False 13:31:06.746351 bus /sierra_3: Setting Powered False 13:31:07.862627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:31:09.007129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.019160 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:31:09.089370 tst mo_mt_call_osmux.py: using LAC 34273 13:31:09.218641 tst mo_mt_call_osmux.py: using RAC 103 13:31:09.347021 tst mo_mt_call_osmux.py: using CellId 34273 13:31:09.474865 tst mo_mt_call_osmux.py: using BVCI 34274 13:31:09.592388 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.604259 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.615786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.627385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.639297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:31:09.651171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:31:09.768225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:31:09.887135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:10.355126 run create_hlr_db(pid=26589): Launched 13:31:10.480912 bus /sierra_2: Setting Powered False 13:31:11.540858 run create_hlr_db(pid=26589): Terminated: ok {rc=0} 13:31:11.981183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Launched 13:31:12.304284 run osmo-hlr_10.42.42.2(pid=26592): Launched 13:31:12.427864 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:12.987386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Launched 13:31:13.309734 run osmo-stp_10.42.42.5(pid=26595): Launched 13:31:13.433883 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:14.017669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26597): Launched 13:31:14.344329 run osmo-msc_10.42.42.6(pid=26598): Launched 13:31:14.525900 run osmo-stp_10.42.42.5(pid=26595): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] 13:31:14.663085 run osmo-stp_10.42.42.5(pid=26595): stdout: | (launched: 2022-12-13_13:31:13.251121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:14.801089 run osmo-stp_10.42.42.5(pid=26595): stderr: | 20221213133113439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133113439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133113439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133113440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133113440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133113440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133113441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:14.936759 run osmo-stp_10.42.42.5(pid=26595): stdout: | (launched: 2022-12-13_13:31:13.251121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:15.065806 run osmo-stp_10.42.42.5(pid=26595): stderr: | 20221213133113439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133113439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133113439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133113440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133113440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133113440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133113441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:15.220504 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26595): Process ended prematurely: osmo-stp_10.42.42.5(pid=26595) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:31:15.230325 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:31:15.257839 run osmo-hlr_10.42.42.2(pid=26592): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26592)] 13:31:15.308248 run osmo-hlr_10.42.42.2(pid=26592): stdout: | (launched: 2022-12-13_13:31:12.245663) 13:31:15.359923 run osmo-hlr_10.42.42.2(pid=26592): stderr: | 20221213133112439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133112439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133112439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133112439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133112439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133112439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133112451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133112460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133112460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133112460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:15.432369 run osmo-msc_10.42.42.6(pid=26598): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26598)] 13:31:15.481916 run osmo-msc_10.42.42.6(pid=26598): stdout: | (launched: 2022-12-13_13:31:14.285074) 13:31:15.533288 run osmo-msc_10.42.42.6(pid=26598): stderr: | 20221213133114603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133114603 DLGLOBAL DEBUG validating counter group 0x7fecb384cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133114603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133114603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133114604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133114604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133114606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133114606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133114606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133114606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:15.585514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Terminating (SIGTERM) 13:31:15.627228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Terminating (SIGTERM) 13:31:15.668867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26597): Terminating (SIGTERM) 13:31:15.710811 --- ParallelTerminationStrategy: PID 26591 died... 13:31:15.731045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Terminated: ok {rc=0} 13:31:15.776931 --- ParallelTerminationStrategy: PID 26594 died... 13:31:15.796609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Terminated: ok {rc=0} 13:31:15.868142 --- ParallelTerminationStrategy: PID 26597 died... 13:31:15.888073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26597): Terminated: ok {rc=0} 13:31:15.976651 bus /sierra_3: Setting Powered False 13:31:17.091372 bus /sierra_3: Setting Powered False 13:31:18.218023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:31:19.479017 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:19.486187 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:31:19.520338 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:31:19.549072 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:31:19.600515 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:31:19.634809 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:31:19.662537 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:31:20.217414 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:31:20.270577 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.282502 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:31:20.356450 tst mo_mt_call.py: using LAC 34274 13:31:20.484102 tst mo_mt_call.py: using RAC 104 13:31:20.610129 tst mo_mt_call.py: using CellId 34274 13:31:20.738338 tst mo_mt_call.py: using BVCI 34275 13:31:20.857325 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.869080 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.880574 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.892105 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.904490 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.916846 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:21.036117 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:21.156797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:21.656485 run create_hlr_db(pid=26603): Launched 13:31:21.782383 bus /sierra_2: Setting Powered False 13:31:22.845772 run create_hlr_db(pid=26603): Terminated: ok {rc=0} 13:31:23.294448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26605): Launched 13:31:23.616830 run osmo-hlr_10.42.42.2(pid=26606): Launched 13:31:23.739435 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:24.292731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26608): Launched 13:31:24.615362 run osmo-stp_10.42.42.5(pid=26609): Launched 13:31:24.738690 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:25.322439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26611): Launched 13:31:25.646074 run osmo-msc_10.42.42.6(pid=26612): Launched 13:31:25.827345 run osmo-stp_10.42.42.5(pid=26609): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26609)] 13:31:25.963917 run osmo-stp_10.42.42.5(pid=26609): stdout: | (launched: 2022-12-13_13:31:24.556487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:26.101540 run osmo-stp_10.42.42.5(pid=26609): stderr: | 20221213133124742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133124742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133124742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133124742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133124743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133124743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133124743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:26.237249 run osmo-stp_10.42.42.5(pid=26609): stdout: | (launched: 2022-12-13_13:31:24.556487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:26.366216 run osmo-stp_10.42.42.5(pid=26609): stderr: | 20221213133124742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133124742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133124742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133124742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133124743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133124743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133124743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:26.519911 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26609): Process ended prematurely: osmo-stp_10.42.42.5(pid=26609) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26609)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:31:26.529623 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:31:26.556790 run osmo-hlr_10.42.42.2(pid=26606): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26606)] 13:31:26.606708 run osmo-hlr_10.42.42.2(pid=26606): stdout: | (launched: 2022-12-13_13:31:23.558286) 13:31:26.657943 run osmo-hlr_10.42.42.2(pid=26606): stderr: | 20221213133123750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133123750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133123750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133123750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133123750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133123750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133123779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133123790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133123790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133123790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:26.729750 run osmo-msc_10.42.42.6(pid=26612): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26612)] 13:31:26.778872 run osmo-msc_10.42.42.6(pid=26612): stdout: | (launched: 2022-12-13_13:31:25.587360) 13:31:26.830074 run osmo-msc_10.42.42.6(pid=26612): stderr: | 20221213133125904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133125904 DLGLOBAL DEBUG validating counter group 0x7f3bb42f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133125904 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133125904 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133125904 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133125904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133125906 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133125906 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133125907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133125907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:26.881702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26605): Terminating (SIGTERM) 13:31:26.923206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26608): Terminating (SIGTERM) 13:31:26.964697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26611): Terminating (SIGTERM) 13:31:27.006809 --- ParallelTerminationStrategy: PID 26605 died... 13:31:27.027164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26605): Terminated: ok {rc=0} 13:31:27.073039 --- ParallelTerminationStrategy: PID 26608 died... 13:31:27.092589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26608): Terminated: ok {rc=0} 13:31:27.137904 --- ParallelTerminationStrategy: PID 26611 died... 13:31:27.157418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26611): Terminated: ok {rc=0} 13:31:27.243909 bus /sierra_3: Setting Powered False 13:31:28.341653 bus /sierra_3: Setting Powered False 13:31:29.455930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:31:30.599644 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:30.611413 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:31:30.681441 tst mo_mt_call_osmux.py: using LAC 34275 13:31:30.800064 tst mo_mt_call_osmux.py: using RAC 105 13:31:30.955090 tst mo_mt_call_osmux.py: using CellId 34275 13:31:31.074700 tst mo_mt_call_osmux.py: using BVCI 34276 13:31:31.198210 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:31.210707 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:31.222981 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:31.235340 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:31.248612 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:31.261885 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:31.382985 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:31.505460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:32.076439 run create_hlr_db(pid=26614): Launched 13:31:32.235508 bus /sierra_2: Setting Powered False 13:31:33.299073 run create_hlr_db(pid=26614): Terminated: ok {rc=0} 13:31:33.747624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Launched 13:31:34.070720 run osmo-hlr_10.42.42.2(pid=26617): Launched 13:31:34.194636 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:34.747274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Launched 13:31:35.069839 run osmo-stp_10.42.42.5(pid=26620): Launched 13:31:35.191928 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:35.775056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Launched 13:31:36.098576 run osmo-msc_10.42.42.6(pid=26623): Launched 13:31:36.279605 run osmo-stp_10.42.42.5(pid=26620): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] 13:31:36.416227 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-13_13:31:35.010734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:36.553799 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221213133135199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133135199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133135199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133135200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133135200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133135201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133135201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:36.689517 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-13_13:31:35.010734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:36.817746 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221213133135199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133135199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133135199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133135200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133135200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133135201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133135201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:36.971980 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:31:36.981849 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:31:37.009344 run osmo-hlr_10.42.42.2(pid=26617): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26617)] 13:31:37.059084 run osmo-hlr_10.42.42.2(pid=26617): stdout: | (launched: 2022-12-13_13:31:34.011827) 13:31:37.110019 run osmo-hlr_10.42.42.2(pid=26617): stderr: | 20221213133134205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133134205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133134205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133134205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133134206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133134206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133134232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133134242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133134242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133134242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:37.181437 run osmo-msc_10.42.42.6(pid=26623): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26623)] 13:31:37.230625 run osmo-msc_10.42.42.6(pid=26623): stdout: | (launched: 2022-12-13_13:31:36.039718) 13:31:37.281815 run osmo-msc_10.42.42.6(pid=26623): stderr: | 20221213133136356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133136356 DLGLOBAL DEBUG validating counter group 0x7f422379ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133136356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133136356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133136356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133136356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133136358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133136359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133136359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133136359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:37.333519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminating (SIGTERM) 13:31:37.374951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminating (SIGTERM) 13:31:37.416641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Terminating (SIGTERM) 13:31:37.458522 --- ParallelTerminationStrategy: PID 26616 died... 13:31:37.478849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminated: ok {rc=0} 13:31:37.524895 --- ParallelTerminationStrategy: PID 26619 died... 13:31:37.544763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminated: ok {rc=0} 13:31:37.590612 --- ParallelTerminationStrategy: PID 26622 died... 13:31:37.610192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26622): Terminated: ok {rc=0} 13:31:37.698098 bus /sierra_3: Setting Powered False 13:31:38.794275 bus /sierra_3: Setting Powered False 13:31:39.911600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:31:41.165946 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:41.172607 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:31:41.205887 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:31:41.232410 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:31:41.281843 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:31:41.314854 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:31:41.341120 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:31:41.893985 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:31:41.948829 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.960498 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:31:42.032657 tst mo_mt_call.py: using LAC 34276 13:31:42.159171 tst mo_mt_call.py: using RAC 106 13:31:42.286132 tst mo_mt_call.py: using CellId 34276 13:31:42.411790 tst mo_mt_call.py: using BVCI 34277 13:31:42.530283 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:42.541919 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:42.553249 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:42.564556 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:42.576278 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:42.588167 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:42.708687 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:42.829511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:43.331987 run create_hlr_db(pid=26628): Launched 13:31:43.455394 bus /sierra_2: Setting Powered False 13:31:44.518727 run create_hlr_db(pid=26628): Terminated: ok {rc=0} 13:31:44.968562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Launched 13:31:45.293623 run osmo-hlr_10.42.42.2(pid=26631): Launched 13:31:45.417512 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:45.985765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Launched 13:31:46.321483 run osmo-stp_10.42.42.5(pid=26634): Launched 13:31:46.565420 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:47.212381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26636): Launched 13:31:47.519640 run osmo-msc_10.42.42.6(pid=26637): Launched 13:31:47.692044 run osmo-stp_10.42.42.5(pid=26634): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] 13:31:47.819554 run osmo-stp_10.42.42.5(pid=26634): stdout: | (launched: 2022-12-13_13:31:46.261936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:47.947450 run osmo-stp_10.42.42.5(pid=26634): stderr: | 20221213133146553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133146553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133146553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133146554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133146554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133146554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133146554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:48.073872 run osmo-stp_10.42.42.5(pid=26634): stdout: | (launched: 2022-12-13_13:31:46.261936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:48.193788 run osmo-stp_10.42.42.5(pid=26634): stderr: | 20221213133146553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133146553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133146553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133146554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133146554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133146554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133146554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:48.337071 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26634): Process ended prematurely: osmo-stp_10.42.42.5(pid=26634) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:31:48.346243 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:31:48.372275 run osmo-hlr_10.42.42.2(pid=26631): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26631)] 13:31:48.419936 run osmo-hlr_10.42.42.2(pid=26631): stdout: | (launched: 2022-12-13_13:31:45.234382) 13:31:48.468828 run osmo-hlr_10.42.42.2(pid=26631): stderr: | 20221213133145426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133145427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133145427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133145427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133145427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133145427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133145445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133145454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133145455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133145455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:48.537600 run osmo-msc_10.42.42.6(pid=26637): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26637)] 13:31:48.584818 run osmo-msc_10.42.42.6(pid=26637): stdout: | (launched: 2022-12-13_13:31:47.464233) 13:31:48.633544 run osmo-msc_10.42.42.6(pid=26637): stderr: | 20221213133147734 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133147734 DLGLOBAL DEBUG validating counter group 0x7f58c279bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133147735 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133147735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133147735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133147735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133147737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133147737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133147737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133147737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:48.682745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Terminating (SIGTERM) 13:31:48.721950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Terminating (SIGTERM) 13:31:48.761747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26636): Terminating (SIGTERM) 13:31:48.801378 --- ParallelTerminationStrategy: PID 26630 died... 13:31:48.820204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Terminated: ok {rc=0} 13:31:48.863637 --- ParallelTerminationStrategy: PID 26633 died... 13:31:48.882132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Terminated: ok {rc=0} 13:31:48.925449 --- ParallelTerminationStrategy: PID 26636 died... 13:31:48.943936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26636): Terminated: ok {rc=0} 13:31:49.027821 bus /sierra_3: Setting Powered False 13:31:50.124582 bus /sierra_3: Setting Powered False 13:31:51.239089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:31:52.389536 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:52.401837 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:31:52.475314 tst mo_mt_call_osmux.py: using LAC 34277 13:31:52.607913 tst mo_mt_call_osmux.py: using RAC 107 13:31:52.734169 tst mo_mt_call_osmux.py: using CellId 34277 13:31:52.859754 tst mo_mt_call_osmux.py: using BVCI 34278 13:31:52.978451 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:52.990352 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:53.002007 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:53.013569 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:53.025551 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:53.037339 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:53.155364 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:53.280245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:53.779910 run create_hlr_db(pid=26639): Launched 13:31:53.903710 bus /sierra_2: Setting Powered False 13:31:54.967678 run create_hlr_db(pid=26639): Terminated: ok {rc=0} 13:31:55.399392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Launched 13:31:55.699937 run osmo-hlr_10.42.42.2(pid=26642): Launched 13:31:55.814059 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:56.331979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Launched 13:31:56.634742 run osmo-stp_10.42.42.5(pid=26645): Launched 13:31:56.748855 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:57.292391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Launched 13:31:57.594866 run osmo-msc_10.42.42.6(pid=26648): Launched 13:31:57.762648 run osmo-stp_10.42.42.5(pid=26645): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] 13:31:57.890285 run osmo-stp_10.42.42.5(pid=26645): stdout: | (launched: 2022-12-13_13:31:56.578980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:58.017591 run osmo-stp_10.42.42.5(pid=26645): stderr: | 20221213133156746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133156746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133156746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133156747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133156747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133156747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133156747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:58.143903 run osmo-stp_10.42.42.5(pid=26645): stdout: | (launched: 2022-12-13_13:31:56.578980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:58.263242 run osmo-stp_10.42.42.5(pid=26645): stderr: | 20221213133156746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133156746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133156746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133156747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133156747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133156747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133156747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:58.406655 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26645): Process ended prematurely: osmo-stp_10.42.42.5(pid=26645) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:31:58.415694 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:31:58.441859 run osmo-hlr_10.42.42.2(pid=26642): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26642)] 13:31:58.489710 run osmo-hlr_10.42.42.2(pid=26642): stdout: | (launched: 2022-12-13_13:31:55.644895) 13:31:58.538852 run osmo-hlr_10.42.42.2(pid=26642): stderr: | 20221213133155818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133155818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133155818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133155818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133155818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133155819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133155831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133155840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133155840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133155840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:58.607626 run osmo-msc_10.42.42.6(pid=26648): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26648)] 13:31:58.654436 run osmo-msc_10.42.42.6(pid=26648): stdout: | (launched: 2022-12-13_13:31:57.538786) 13:31:58.703014 run osmo-msc_10.42.42.6(pid=26648): stderr: | 20221213133157809 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133157809 DLGLOBAL DEBUG validating counter group 0x7f812f847c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133157809 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133157809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133157809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133157810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133157811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133157812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133157812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133157812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:58.751962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Terminating (SIGTERM) 13:31:58.791176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminating (SIGTERM) 13:31:58.830583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Terminating (SIGTERM) 13:31:58.870172 --- ParallelTerminationStrategy: PID 26641 died... 13:31:58.889207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26641): Terminated: ok {rc=0} 13:31:58.932917 --- ParallelTerminationStrategy: PID 26644 died... 13:31:58.951821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminated: ok {rc=0} 13:31:58.995155 --- ParallelTerminationStrategy: PID 26647 died... 13:31:59.013491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26647): Terminated: ok {rc=0} 13:31:59.097354 bus /sierra_3: Setting Powered False 13:32:00.194935 bus /sierra_3: Setting Powered False 13:32:01.315070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 13:32:02.558350 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:02.563120 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:32:02.596783 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:32:02.625024 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:32:02.707837 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:32:02.741526 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:32:02.768138 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:32:03.353637 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 13:32:03.358778 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.369732 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:32:03.418702 tst emergency_mo_mt_call.py: using LAC 34278 13:32:03.532753 tst emergency_mo_mt_call.py: using RAC 108 13:32:03.647232 tst emergency_mo_mt_call.py: using CellId 34278 13:32:03.761532 tst emergency_mo_mt_call.py: using BVCI 34279 13:32:03.867216 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.878182 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.888655 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.899209 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.909772 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:03.921121 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:04.042886 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:04.162846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:04.655687 run create_hlr_db(pid=26653): Launched 13:32:04.779045 bus /sierra_2: Setting Powered False 13:32:05.838777 run create_hlr_db(pid=26653): Terminated: ok {rc=0} 13:32:06.250884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26655): Launched 13:32:06.546414 run osmo-hlr_10.42.42.2(pid=26656): Launched 13:32:06.660625 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:07.166970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26658): Launched 13:32:07.462331 run osmo-stp_10.42.42.5(pid=26659): Launched 13:32:07.583794 tst emergency_mo_mt_call.py: using MSISDN 8181 13:32:07.733235 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:08.265192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26661): Launched 13:32:08.561106 run osmo-msc_10.42.42.6(pid=26662): Launched 13:32:08.726796 run osmo-stp_10.42.42.5(pid=26659): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26659)] 13:32:08.851377 run osmo-stp_10.42.42.5(pid=26659): stdout: | (launched: 2022-12-13_13:32:07.407754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:08.976404 run osmo-stp_10.42.42.5(pid=26659): stderr: | 20221213133207575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133207576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133207576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133207577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133207578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133207578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133207578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:09.099667 run osmo-stp_10.42.42.5(pid=26659): stdout: | (launched: 2022-12-13_13:32:07.407754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:09.217157 run osmo-stp_10.42.42.5(pid=26659): stderr: | 20221213133207575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133207576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133207576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133207577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133207578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133207578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133207578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:09.357572 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26659): Process ended prematurely: osmo-stp_10.42.42.5(pid=26659) [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26659)] [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 13:32:09.366186 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 13:32:09.392373 run osmo-hlr_10.42.42.2(pid=26656): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26656)] 13:32:09.440294 run osmo-hlr_10.42.42.2(pid=26656): stdout: | (launched: 2022-12-13_13:32:06.492140) 13:32:09.489159 run osmo-hlr_10.42.42.2(pid=26656): stderr: | 20221213133206665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133206665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133206665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133206665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133206665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133206665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133206677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133206686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133206686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133206686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:09.557151 run osmo-msc_10.42.42.6(pid=26662): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26662)] 13:32:09.604753 run osmo-msc_10.42.42.6(pid=26662): stdout: | (launched: 2022-12-13_13:32:08.506890) 13:32:09.653610 run osmo-msc_10.42.42.6(pid=26662): stderr: | 20221213133208776 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133208776 DLGLOBAL DEBUG validating counter group 0x7f8faec01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133208776 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133208776 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133208776 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133208777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133208778 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133208779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133208779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133208779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:09.702681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26655): Terminating (SIGTERM) 13:32:09.742534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26658): Terminating (SIGTERM) 13:32:09.782177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26661): Terminating (SIGTERM) 13:32:09.822173 --- ParallelTerminationStrategy: PID 26655 died... 13:32:09.841262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26655): Terminated: ok {rc=0} 13:32:09.885176 --- ParallelTerminationStrategy: PID 26658 died... 13:32:09.903815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26658): Terminated: ok {rc=0} 13:32:09.947688 --- ParallelTerminationStrategy: PID 26661 died... 13:32:09.966403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26661): Terminated: ok {rc=0} 13:32:10.049386 bus /sierra_3: Setting Powered False 13:32:11.147228 bus /sierra_3: Setting Powered False 13:32:12.264410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 13:32:13.351374 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.362879 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:32:13.414363 tst emergency_preemptive_call.py: using LAC 34279 13:32:13.530352 tst emergency_preemptive_call.py: using RAC 109 13:32:13.646452 tst emergency_preemptive_call.py: using CellId 34279 13:32:13.764492 tst emergency_preemptive_call.py: using BVCI 34280 13:32:13.872075 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.883164 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.893998 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.904532 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.915773 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:32:13.927148 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:14.042377 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:14.162519 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:14.277680 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:14.391451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:14.850778 run create_hlr_db(pid=26664): Launched 13:32:14.973972 bus /sierra_2: Setting Powered False 13:32:16.042094 run create_hlr_db(pid=26664): Terminated: ok {rc=0} 13:32:16.496805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Launched 13:32:16.836498 run osmo-hlr_10.42.42.2(pid=26667): Launched 13:32:17.080645 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:17.618625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Launched 13:32:17.914583 run osmo-stp_10.42.42.5(pid=26670): Launched 13:32:18.037345 tst emergency_preemptive_call.py: using MSISDN 8182 13:32:18.189213 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:18.724027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Launched 13:32:19.020141 run osmo-msc_10.42.42.6(pid=26673): Launched 13:32:19.184621 run osmo-stp_10.42.42.5(pid=26670): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] 13:32:19.309332 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-13_13:32:17.860139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:19.434154 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221213133218027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133218027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133218028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133218028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133218029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133218029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133218029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:19.557559 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-13_13:32:17.860139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:19.675226 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221213133218027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133218027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133218028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133218028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133218029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133218029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133218029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:19.815727 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 13:32:19.824414 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 13:32:19.850424 run osmo-hlr_10.42.42.2(pid=26667): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26667)] 13:32:19.898225 run osmo-hlr_10.42.42.2(pid=26667): stdout: | (launched: 2022-12-13_13:32:16.776181) 13:32:19.947604 run osmo-hlr_10.42.42.2(pid=26667): stderr: | 20221213133217072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133217072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133217072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133217072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133217072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133217072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133217092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133217109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133217110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133217110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:20.016629 run osmo-msc_10.42.42.6(pid=26673): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26673)] 13:32:20.063906 run osmo-msc_10.42.42.6(pid=26673): stdout: | (launched: 2022-12-13_13:32:18.965906) 13:32:20.113155 run osmo-msc_10.42.42.6(pid=26673): stderr: | 20221213133219236 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133219236 DLGLOBAL DEBUG validating counter group 0x7f6caa4adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133219236 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133219236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133219237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133219237 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133219239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133219239 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133219239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133219239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:20.162164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminating (SIGTERM) 13:32:20.201694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminating (SIGTERM) 13:32:20.241288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Terminating (SIGTERM) 13:32:20.281122 --- ParallelTerminationStrategy: PID 26666 died... 13:32:20.300178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminated: ok {rc=0} 13:32:20.344052 --- ParallelTerminationStrategy: PID 26669 died... 13:32:20.362928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminated: ok {rc=0} 13:32:20.406407 --- ParallelTerminationStrategy: PID 26672 died... 13:32:20.425031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26672): Terminated: ok {rc=0} 13:32:20.510545 bus /sierra_9: Setting Powered False 13:32:21.608325 bus /sierra_9: Setting Powered False 13:32:22.722262 bus /sierra_8: Setting Powered False 13:32:23.820537 bus /sierra_8: Setting Powered False 13:32:24.935853 bus /sierra_3: Setting Powered False 13:32:26.032716 bus /sierra_3: Setting Powered False 13:32:27.147019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 13:32:28.426080 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:28.431538 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:32:28.466417 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 13:32:28.506785 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:32:28.595692 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:32:28.629795 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 13:32:28.669043 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:32:29.259318 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 13:32:29.308881 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.319726 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:32:29.374050 tst cs_paging_gprs_active.py: using LAC 34280 13:32:29.491889 tst cs_paging_gprs_active.py: using RAC 110 13:32:29.610124 tst cs_paging_gprs_active.py: using CellId 34280 13:32:29.729732 tst cs_paging_gprs_active.py: using BVCI 34281 13:32:29.840285 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.851031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.861592 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.872123 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.882523 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.893031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.903723 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.914240 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:29.924920 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:30.047562 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:30.164683 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:32:30.367944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:30.672025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26679): Launched 13:32:30.965785 run iperf3-srv_10.42.42.10(pid=26680): Launched 13:32:31.129048 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:32:31.369648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:31.710961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Launched 13:32:32.018156 run iperf3-srv_10.42.42.10(pid=26682): Launched 13:32:32.146376 tst cs_paging_gprs_active.py:38: start network... 13:32:32.370723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:32.878210 run create_hlr_db(pid=26683): Launched 13:32:33.004144 bus /sierra_2: Setting Powered False 13:32:34.066924 run create_hlr_db(pid=26683): Terminated: ok {rc=0} 13:32:34.520217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26685): Launched 13:32:34.847518 run osmo-hlr_10.42.42.2(pid=26686): Launched 13:32:34.971997 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:35.540118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26688): Launched 13:32:35.867408 run osmo-stp_10.42.42.5(pid=26689): Launched 13:32:35.992266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:36.556014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Launched 13:32:36.683833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:36.962043 run patchelf(pid=26692): Launched 13:32:37.144854 run osmo-stp_10.42.42.5(pid=26689): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26689)] 13:32:37.283478 run osmo-stp_10.42.42.5(pid=26689): stdout: | (launched: 2022-12-13_13:32:35.807784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:37.424169 run osmo-stp_10.42.42.5(pid=26689): stderr: | 20221213133235996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133235996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133235996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133235997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133235997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133235997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133235997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:37.564433 run osmo-stp_10.42.42.5(pid=26689): stdout: | (launched: 2022-12-13_13:32:35.807784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:37.698314 run osmo-stp_10.42.42.5(pid=26689): stderr: | 20221213133235996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133235996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133235996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133235997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133235997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133235997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133235997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:37.857601 run patchelf(pid=26692): Terminating (SIGINT) 13:32:38.041722 run patchelf(pid=26692): Terminated: ok {rc=0} 13:32:38.174683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26689): Process ended prematurely: osmo-stp_10.42.42.5(pid=26689) [trial-2390↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26689)] [trial-2390↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 13:32:38.185041 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:32:38.213226 run osmo-hlr_10.42.42.2(pid=26686): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26686)] 13:32:38.262990 run osmo-hlr_10.42.42.2(pid=26686): stdout: | (launched: 2022-12-13_13:32:34.787545) 13:32:38.314242 run osmo-hlr_10.42.42.2(pid=26686): stderr: | 20221213133234982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133234982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133234983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133234983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133234983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133234983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133234996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133235004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133235004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133235004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:38.365870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26679): Terminating (SIGTERM) 13:32:38.407459 run iperf3-srv_10.42.42.10(pid=26680): Terminating (SIGTERM) 13:32:38.448535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Terminating (SIGTERM) 13:32:38.490132 run iperf3-srv_10.42.42.10(pid=26682): Terminating (SIGTERM) 13:32:38.531502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26685): Terminating (SIGTERM) 13:32:38.573149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26688): Terminating (SIGTERM) 13:32:38.614804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Terminating (SIGTERM) 13:32:38.656477 --- ParallelTerminationStrategy: PID 26679 died... 13:32:38.676598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26679): Terminated: ok {rc=0} 13:32:38.722563 --- ParallelTerminationStrategy: PID 26680 died... 13:32:38.742292 run iperf3-srv_10.42.42.10(pid=26680): Terminated {rc=256} 13:32:38.787783 --- ParallelTerminationStrategy: PID 26681 died... 13:32:38.807592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Terminated: ok {rc=0} 13:32:38.853248 --- ParallelTerminationStrategy: PID 26682 died... 13:32:38.872649 run iperf3-srv_10.42.42.10(pid=26682): Terminated {rc=256} 13:32:38.918689 --- ParallelTerminationStrategy: PID 26685 died... 13:32:38.938274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26685): Terminated: ok {rc=0} 13:32:38.983661 --- ParallelTerminationStrategy: PID 26688 died... 13:32:39.003514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26688): Terminated: ok {rc=0} 13:32:39.049528 --- ParallelTerminationStrategy: PID 26691 died... 13:32:39.069639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Terminated: ok {rc=0} 13:32:39.158069 bus /gobi_0: Setting Powered False 13:32:40.256338 bus /gobi_0: Setting Powered False 13:32:41.374276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 13:32:42.524152 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:42.536177 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:32:42.589334 tst iperf3.py: using LAC 34281 13:32:42.716370 tst iperf3.py: using RAC 111 13:32:42.843608 tst iperf3.py: using CellId 34281 13:32:42.965533 tst iperf3.py: using BVCI 34282 13:32:43.087754 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.099286 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.110577 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.121970 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.133750 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.145290 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.156889 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.168342 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:43.180408 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:43.298541 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:32:43.504410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:43.811290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Launched 13:32:44.077994 run iperf3-srv_10.42.42.10(pid=26694): Launched 13:32:44.195519 tst iperf3.py:8: start network... 13:32:44.400835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:44.877568 run create_hlr_db(pid=26695): Launched 13:32:45.004119 bus /gobi_6: Setting Powered False 13:32:46.068074 run create_hlr_db(pid=26695): Terminated: ok {rc=0} 13:32:46.537088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Launched 13:32:46.886043 run osmo-hlr_10.42.42.2(pid=26698): Launched 13:32:47.139847 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:47.725980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Launched 13:32:48.057654 run osmo-stp_10.42.42.5(pid=26701): Launched 13:32:48.185185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:48.755105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Launched 13:32:48.882632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:49.162071 run patchelf(pid=26704): Launched 13:32:49.345039 run osmo-stp_10.42.42.5(pid=26701): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] 13:32:49.483747 run osmo-stp_10.42.42.5(pid=26701): stdout: | (launched: 2022-12-13_13:32:47.997115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:49.623940 run osmo-stp_10.42.42.5(pid=26701): stderr: | 20221213133248184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133248184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133248185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133248185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133248186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133248186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133248186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:49.764724 run osmo-stp_10.42.42.5(pid=26701): stdout: | (launched: 2022-12-13_13:32:47.997115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:49.899163 run osmo-stp_10.42.42.5(pid=26701): stderr: | 20221213133248184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133248184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133248185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133248185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133248186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133248186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133248186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:50.059939 run patchelf(pid=26704): Terminating (SIGINT) 13:32:50.244320 run patchelf(pid=26704): Terminated: ok {rc=0} 13:32:50.376896 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26701): Process ended prematurely: osmo-stp_10.42.42.5(pid=26701) [trial-2390↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] [trial-2390↪gprs:trx-sysmocell5000↪iperf3.py:8] 13:32:50.387558 tst iperf3.py:8: Test FAILED (7.9 sec) 13:32:50.415972 run osmo-hlr_10.42.42.2(pid=26698): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26698)] 13:32:50.466559 run osmo-hlr_10.42.42.2(pid=26698): stdout: | (launched: 2022-12-13_13:32:46.825857) 13:32:50.518650 run osmo-hlr_10.42.42.2(pid=26698): stderr: | 20221213133247134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133247134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133247134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133247134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133247134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133247135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133247146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133247154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133247154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133247154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:50.570692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Terminating (SIGTERM) 13:32:50.612756 run iperf3-srv_10.42.42.10(pid=26694): Terminating (SIGTERM) 13:32:50.654734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Terminating (SIGTERM) 13:32:50.697685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Terminating (SIGTERM) 13:32:50.739717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Terminating (SIGTERM) 13:32:50.782466 --- ParallelTerminationStrategy: PID 26693 died... 13:32:50.802774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Terminated: ok {rc=0} 13:32:50.848904 --- ParallelTerminationStrategy: PID 26694 died... 13:32:50.868646 run iperf3-srv_10.42.42.10(pid=26694): Terminated {rc=256} 13:32:50.914598 --- ParallelTerminationStrategy: PID 26697 died... 13:32:50.934431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Terminated: ok {rc=0} 13:32:50.980733 --- ParallelTerminationStrategy: PID 26700 died... 13:32:51.001082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Terminated: ok {rc=0} 13:32:51.047828 --- ParallelTerminationStrategy: PID 26703 died... 13:32:51.067938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Terminated: ok {rc=0} 13:32:51.155663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 13:32:52.305758 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.317743 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:32:52.369157 tst iperf3m4.py: using LAC 34282 13:32:52.491180 tst iperf3m4.py: using RAC 112 13:32:52.614090 tst iperf3m4.py: using CellId 34282 13:32:52.737284 tst iperf3m4.py: using BVCI 34283 13:32:52.848799 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.859966 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.870653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.881254 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.891681 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.903437 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.914887 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.926031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:32:52.937275 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:53.055223 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:53.177335 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:53.294578 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:32:53.416083 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:32:53.637710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:53.965566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26705): Launched 13:32:54.251484 run iperf3-srv_10.42.42.10(pid=26706): Launched 13:32:54.374895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:32:54.595362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:54.923982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26707): Launched 13:32:55.209579 run iperf3-srv_10.42.42.10(pid=26708): Launched 13:32:55.335279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:32:55.557111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:55.886542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26709): Launched 13:32:56.171781 run iperf3-srv_10.42.42.10(pid=26710): Launched 13:32:56.296225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:32:56.517077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:56.845052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26711): Launched 13:32:57.131162 run iperf3-srv_10.42.42.10(pid=26712): Launched 13:32:57.255235 tst iperf3m4.py:8: start network... 13:32:57.476752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:57.985574 run create_hlr_db(pid=26713): Launched 13:32:58.112079 bus /gobi_6: Setting Powered False 13:32:59.176021 run create_hlr_db(pid=26713): Terminated: ok {rc=0} 13:32:59.613080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26715): Launched 13:32:59.918793 run osmo-hlr_10.42.42.2(pid=26716): Launched 13:33:00.034312 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:00.561918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26718): Launched 13:33:00.895411 run osmo-stp_10.42.42.5(pid=26719): Launched 13:33:01.099532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:01.817730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26722): Launched 13:33:01.958422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:02.243593 run patchelf(pid=26723): Launched 13:33:02.439629 run osmo-stp_10.42.42.5(pid=26719): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26719)] 13:33:02.579983 run osmo-stp_10.42.42.5(pid=26719): stdout: | (launched: 2022-12-13_13:33:00.833567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:02.720821 run osmo-stp_10.42.42.5(pid=26719): stderr: | 20221213133301200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133301201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133301204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133301208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133301208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133301209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133301209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:02.861935 run osmo-stp_10.42.42.5(pid=26719): stdout: | (launched: 2022-12-13_13:33:00.833567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:02.997377 run osmo-stp_10.42.42.5(pid=26719): stderr: | 20221213133301200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133301201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133301204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133301208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133301208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133301209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133301209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:03.158289 run patchelf(pid=26723): Terminating (SIGINT) 13:33:03.343009 run patchelf(pid=26723): Terminated: ok {rc=0} 13:33:03.476096 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26719): Process ended prematurely: osmo-stp_10.42.42.5(pid=26719) [trial-2390↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26719)] [trial-2390↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 13:33:03.486814 tst iperf3m4.py:8: Test FAILED (11.2 sec) 13:33:03.515771 run osmo-hlr_10.42.42.2(pid=26716): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26716)] 13:33:03.567021 run osmo-hlr_10.42.42.2(pid=26716): stdout: | (launched: 2022-12-13_13:32:59.862339) 13:33:03.619303 run osmo-hlr_10.42.42.2(pid=26716): stderr: | 20221213133300037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133300037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133300037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133300037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133300037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133300037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133300050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133300060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133300060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133300060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:03.672088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26705): Terminating (SIGTERM) 13:33:03.714688 run iperf3-srv_10.42.42.10(pid=26706): Terminating (SIGTERM) 13:33:03.757240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26707): Terminating (SIGTERM) 13:33:03.800217 run iperf3-srv_10.42.42.10(pid=26708): Terminating (SIGTERM) 13:33:03.843166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26709): Terminating (SIGTERM) 13:33:03.885829 run iperf3-srv_10.42.42.10(pid=26710): Terminating (SIGTERM) 13:33:03.928427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26711): Terminating (SIGTERM) 13:33:03.971169 run iperf3-srv_10.42.42.10(pid=26712): Terminating (SIGTERM) 13:33:04.014480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26715): Terminating (SIGTERM) 13:33:04.056721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26718): Terminating (SIGTERM) 13:33:04.099624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26722): Terminating (SIGTERM) 13:33:04.142434 --- ParallelTerminationStrategy: PID 26705 died... 13:33:04.162546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26705): Terminated: ok {rc=0} 13:33:04.208822 --- ParallelTerminationStrategy: PID 26706 died... 13:33:04.228512 run iperf3-srv_10.42.42.10(pid=26706): Terminated {rc=256} 13:33:04.274925 --- ParallelTerminationStrategy: PID 26707 died... 13:33:04.294791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26707): Terminated: ok {rc=0} 13:33:04.341151 --- ParallelTerminationStrategy: PID 26708 died... 13:33:04.361265 run iperf3-srv_10.42.42.10(pid=26708): Terminated {rc=256} 13:33:04.407529 --- ParallelTerminationStrategy: PID 26709 died... 13:33:04.427362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26709): Terminated: ok {rc=0} 13:33:04.473661 --- ParallelTerminationStrategy: PID 26710 died... 13:33:04.493563 run iperf3-srv_10.42.42.10(pid=26710): Terminated {rc=256} 13:33:04.539802 --- ParallelTerminationStrategy: PID 26711 died... 13:33:04.559725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26711): Terminated: ok {rc=0} 13:33:04.605955 --- ParallelTerminationStrategy: PID 26712 died... 13:33:04.625828 run iperf3-srv_10.42.42.10(pid=26712): Terminated {rc=256} 13:33:04.671975 --- ParallelTerminationStrategy: PID 26715 died... 13:33:04.691938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26715): Terminated: ok {rc=0} 13:33:04.738143 --- ParallelTerminationStrategy: PID 26718 died... 13:33:04.758030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26718): Terminated: ok {rc=0} 13:33:04.804182 --- ParallelTerminationStrategy: PID 26722 died... 13:33:04.823981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26722): Terminated: ok {rc=0} 13:33:04.912238 bus /gobi_4: Setting Powered False 13:33:06.011011 bus /gobi_4: Setting Powered False 13:33:07.128809 bus /gobi_1: Setting Powered False 13:33:08.227470 bus /gobi_1: Setting Powered False 13:33:09.342542 bus /gobi_0: Setting Powered False 13:33:10.441290 bus /gobi_0: Setting Powered False 13:33:11.557373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 13:33:12.660150 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:12.671787 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:33:12.721866 tst ping.py: using LAC 34283 13:33:12.841200 tst ping.py: using RAC 113 13:33:12.958539 tst ping.py: using CellId 34283 13:33:13.077973 tst ping.py: using BVCI 34284 13:33:13.195700 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.207091 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.218316 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.229452 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.240804 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.252118 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.263640 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:13.275150 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:33:13.392294 tst ping.py:19: start network... 13:33:13.593669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:14.056626 run create_hlr_db(pid=26725): Launched 13:33:14.181117 bus /gobi_6: Setting Powered False 13:33:15.241058 run create_hlr_db(pid=26725): Terminated: ok {rc=0} 13:33:15.679753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26727): Launched 13:33:16.009451 run osmo-hlr_10.42.42.2(pid=26728): Launched 13:33:16.249577 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:16.936694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26730): Launched 13:33:17.258791 run osmo-stp_10.42.42.5(pid=26731): Launched 13:33:17.371912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:17.890583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26733): Launched 13:33:18.006823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:18.259305 run patchelf(pid=26734): Launched 13:33:18.425904 run osmo-stp_10.42.42.5(pid=26731): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26731)] 13:33:18.553500 run osmo-stp_10.42.42.5(pid=26731): stdout: | (launched: 2022-12-13_13:33:17.202570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:18.682808 run osmo-stp_10.42.42.5(pid=26731): stderr: | 20221213133317368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133317368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133317369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133317369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133317370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133317370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133317370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:18.811869 run osmo-stp_10.42.42.5(pid=26731): stdout: | (launched: 2022-12-13_13:33:17.202570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:18.934715 run osmo-stp_10.42.42.5(pid=26731): stderr: | 20221213133317368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133317368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133317369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133317369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133317370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133317370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133317370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:19.080644 run patchelf(pid=26734): Terminating (SIGINT) 13:33:19.250238 run patchelf(pid=26734): Terminated: ok {rc=0} 13:33:19.371346 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26731): Process ended prematurely: osmo-stp_10.42.42.5(pid=26731) [trial-2390↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26731)] [trial-2390↪gprs:trx-sysmocell5000↪ping.py:22] 13:33:19.380198 tst ping.py:22: Test FAILED (6.7 sec) 13:33:19.406914 run osmo-hlr_10.42.42.2(pid=26728): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26728)] 13:33:19.454606 run osmo-hlr_10.42.42.2(pid=26728): stdout: | (launched: 2022-12-13_13:33:15.950052) 13:33:19.503832 run osmo-hlr_10.42.42.2(pid=26728): stderr: | 20221213133316292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133316292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133316292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133316292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133316292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133316293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133316311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133316328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133316328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133316328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:19.553461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26727): Terminating (SIGTERM) 13:33:19.593303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26730): Terminating (SIGTERM) 13:33:19.633086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26733): Terminating (SIGTERM) 13:33:19.673295 --- ParallelTerminationStrategy: PID 26727 died... 13:33:19.692646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26727): Terminated: ok {rc=0} 13:33:19.736916 --- ParallelTerminationStrategy: PID 26730 died... 13:33:19.755827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26730): Terminated: ok {rc=0} 13:33:19.799626 --- ParallelTerminationStrategy: PID 26733 died... 13:33:19.818408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26733): Terminated: ok {rc=0} 13:33:19.903929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 13:33:20.992454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.003889 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:33:21.054539 tst ping_idle_ping.py: using LAC 34284 13:33:21.173615 tst ping_idle_ping.py: using RAC 114 13:33:21.298099 tst ping_idle_ping.py: using CellId 34284 13:33:21.415326 tst ping_idle_ping.py: using BVCI 34285 13:33:21.525715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.536457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.547084 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.557685 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.568157 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.580151 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.591412 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:33:21.602660 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:33:21.717892 tst ping_idle_ping.py:24: start network... 13:33:21.937317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:22.440584 run create_hlr_db(pid=26735): Launched 13:33:22.564517 bus /gobi_6: Setting Powered False 13:33:23.627580 run create_hlr_db(pid=26735): Terminated: ok {rc=0} 13:33:24.058676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Launched 13:33:24.361640 run osmo-hlr_10.42.42.2(pid=26738): Launched 13:33:24.475196 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:24.994370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Launched 13:33:25.300512 run osmo-stp_10.42.42.5(pid=26741): Launched 13:33:25.414112 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:25.931491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26743): Launched 13:33:26.045875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:26.299104 run patchelf(pid=26744): Launched 13:33:26.465753 run osmo-stp_10.42.42.5(pid=26741): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] 13:33:26.592936 run osmo-stp_10.42.42.5(pid=26741): stdout: | (launched: 2022-12-13_13:33:25.243979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:26.721827 run osmo-stp_10.42.42.5(pid=26741): stderr: | 20221213133325412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133325412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133325413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133325413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133325414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133325414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133325414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:26.850722 run osmo-stp_10.42.42.5(pid=26741): stdout: | (launched: 2022-12-13_13:33:25.243979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:26.973411 run osmo-stp_10.42.42.5(pid=26741): stderr: | 20221213133325412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133325412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133325413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133325413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133325414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133325414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133325414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:27.118750 run patchelf(pid=26744): Terminating (SIGINT) 13:33:27.289244 run patchelf(pid=26744): Terminated: ok {rc=0} 13:33:27.411374 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26741): Process ended prematurely: osmo-stp_10.42.42.5(pid=26741) [trial-2390↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] [trial-2390↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 13:33:27.420268 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:33:27.446884 run osmo-hlr_10.42.42.2(pid=26738): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26738)] 13:33:27.494174 run osmo-hlr_10.42.42.2(pid=26738): stdout: | (launched: 2022-12-13_13:33:24.305107) 13:33:27.543108 run osmo-hlr_10.42.42.2(pid=26738): stderr: | 20221213133324479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133324479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133324479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133324479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133324479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133324479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133324494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133324503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133324503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133324503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:27.592592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Terminating (SIGTERM) 13:33:27.632408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Terminating (SIGTERM) 13:33:27.672024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26743): Terminating (SIGTERM) 13:33:27.712018 --- ParallelTerminationStrategy: PID 26737 died... 13:33:27.730987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Terminated: ok {rc=0} 13:33:27.774883 --- ParallelTerminationStrategy: PID 26740 died... 13:33:27.793840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Terminated: ok {rc=0} 13:33:27.837694 --- ParallelTerminationStrategy: PID 26743 died... 13:33:27.856376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26743): Terminated: ok {rc=0} 13:33:27.941682 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 13:33:29.250197 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:33:29.255872 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:33:29.289779 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:33:29.329407 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:33:29.417395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:33:29.451110 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:33:29.489221 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:33:30.083852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:33:30.132612 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.143571 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:33:30.193774 tst cs_paging_gprs_active.py: using LAC 34285 13:33:30.321292 tst cs_paging_gprs_active.py: using RAC 115 13:33:30.445065 tst cs_paging_gprs_active.py: using CellId 34285 13:33:30.565579 tst cs_paging_gprs_active.py: using BVCI 34286 13:33:30.679093 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.690183 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.701103 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.711841 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.723037 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.734343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.745720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.756932 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:30.768345 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:30.909055 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:31.044870 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:33:31.274488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:31.624760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26749): Launched 13:33:31.917698 run iperf3-srv_10.42.42.10(pid=26750): Launched 13:33:32.071452 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:33:32.299219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:32.630557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Launched 13:33:32.916899 run iperf3-srv_10.42.42.10(pid=26752): Launched 13:33:33.040373 tst cs_paging_gprs_active.py:38: start network... 13:33:33.261968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:33.772736 run create_hlr_db(pid=26753): Launched 13:33:33.898095 bus /gobi_6: Setting Powered False 13:33:34.962088 run create_hlr_db(pid=26753): Terminated: ok {rc=0} 13:33:35.400905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Launched 13:33:35.707749 run osmo-hlr_10.42.42.2(pid=26756): Launched 13:33:35.824137 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:36.368606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Launched 13:33:36.674843 run osmo-stp_10.42.42.5(pid=26759): Launched 13:33:36.790975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:37.319652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26761): Launched 13:33:37.438673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:37.697662 run patchelf(pid=26762): Launched 13:33:37.867565 run osmo-stp_10.42.42.5(pid=26759): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] 13:33:37.997691 run osmo-stp_10.42.42.5(pid=26759): stdout: | (launched: 2022-12-13_13:33:36.618502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:38.128650 run osmo-stp_10.42.42.5(pid=26759): stderr: | 20221213133336787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133336787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133336788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133336788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133336789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133336789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133336789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:38.259460 run osmo-stp_10.42.42.5(pid=26759): stdout: | (launched: 2022-12-13_13:33:36.618502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:38.384827 run osmo-stp_10.42.42.5(pid=26759): stderr: | 20221213133336787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133336787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133336788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133336788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133336789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133336789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133336789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:38.533272 run patchelf(pid=26762): Terminating (SIGINT) 13:33:38.704510 run patchelf(pid=26762): Terminated: ok {rc=0} 13:33:38.838920 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26759): Process ended prematurely: osmo-stp_10.42.42.5(pid=26759) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:33:38.849216 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:33:38.877324 run osmo-hlr_10.42.42.2(pid=26756): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26756)] 13:33:38.927448 run osmo-hlr_10.42.42.2(pid=26756): stdout: | (launched: 2022-12-13_13:33:35.651754) 13:33:38.979253 run osmo-hlr_10.42.42.2(pid=26756): stderr: | 20221213133335825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133335825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133335825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133335825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133335825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133335825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133335837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133335846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133335846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133335846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:39.031116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26749): Terminating (SIGTERM) 13:33:39.073233 run iperf3-srv_10.42.42.10(pid=26750): Terminating (SIGTERM) 13:33:39.114962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Terminating (SIGTERM) 13:33:39.157321 run iperf3-srv_10.42.42.10(pid=26752): Terminating (SIGTERM) 13:33:39.199691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Terminating (SIGTERM) 13:33:39.242046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Terminating (SIGTERM) 13:33:39.283824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26761): Terminating (SIGTERM) 13:33:39.326376 --- ParallelTerminationStrategy: PID 26749 died... 13:33:39.346557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26749): Terminated: ok {rc=0} 13:33:39.392535 --- ParallelTerminationStrategy: PID 26750 died... 13:33:39.412148 run iperf3-srv_10.42.42.10(pid=26750): Terminated {rc=256} 13:33:39.458367 --- ParallelTerminationStrategy: PID 26751 died... 13:33:39.478016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Terminated: ok {rc=0} 13:33:39.523765 --- ParallelTerminationStrategy: PID 26752 died... 13:33:39.543359 run iperf3-srv_10.42.42.10(pid=26752): Terminated {rc=256} 13:33:39.589201 --- ParallelTerminationStrategy: PID 26755 died... 13:33:39.608680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26755): Terminated: ok {rc=0} 13:33:39.654587 --- ParallelTerminationStrategy: PID 26758 died... 13:33:39.674281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26758): Terminated: ok {rc=0} 13:33:39.720167 --- ParallelTerminationStrategy: PID 26761 died... 13:33:39.739813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26761): Terminated: ok {rc=0} 13:33:39.826522 bus /gobi_0: Setting Powered False 13:33:40.924751 bus /gobi_0: Setting Powered False 13:33:42.039942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:33:43.186211 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.197766 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:33:43.257416 tst iperf3.py: using LAC 34286 13:33:43.377061 tst iperf3.py: using RAC 116 13:33:43.494623 tst iperf3.py: using CellId 34286 13:33:43.612186 tst iperf3.py: using BVCI 34287 13:33:43.722694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.733833 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.744618 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.755399 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.766149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.777356 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.788545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.799251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:43.810168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:43.926199 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:44.129289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:44.433720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26763): Launched 13:33:44.699702 run iperf3-srv_10.42.42.10(pid=26764): Launched 13:33:44.814337 tst iperf3.py:8: start network... 13:33:45.018068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:45.490676 run create_hlr_db(pid=26765): Launched 13:33:45.617628 bus /gobi_6: Setting Powered False 13:33:46.689761 run create_hlr_db(pid=26765): Terminated: ok {rc=0} 13:33:47.220230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26767): Launched 13:33:47.559246 run osmo-hlr_10.42.42.2(pid=26768): Launched 13:33:47.686360 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:48.256205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26770): Launched 13:33:48.585878 run osmo-stp_10.42.42.5(pid=26771): Launched 13:33:48.710822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:49.274658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26773): Launched 13:33:49.399975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:49.677106 run patchelf(pid=26774): Launched 13:33:49.858983 run osmo-stp_10.42.42.5(pid=26771): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26771)] 13:33:49.997824 run osmo-stp_10.42.42.5(pid=26771): stdout: | (launched: 2022-12-13_13:33:48.526130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:50.139108 run osmo-stp_10.42.42.5(pid=26771): stderr: | 20221213133348713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133348713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133348714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133348714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133348714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133348715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133348715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:50.279733 run osmo-stp_10.42.42.5(pid=26771): stdout: | (launched: 2022-12-13_13:33:48.526130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:50.414485 run osmo-stp_10.42.42.5(pid=26771): stderr: | 20221213133348713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133348713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133348714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133348714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133348714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133348715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133348715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:50.573878 run patchelf(pid=26774): Terminating (SIGINT) 13:33:50.757816 run patchelf(pid=26774): Terminated: ok {rc=0} 13:33:50.890167 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26771): Process ended prematurely: osmo-stp_10.42.42.5(pid=26771) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26771)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 13:33:50.900513 tst iperf3.py:8: Test FAILED (7.7 sec) 13:33:50.929022 run osmo-hlr_10.42.42.2(pid=26768): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26768)] 13:33:50.979532 run osmo-hlr_10.42.42.2(pid=26768): stdout: | (launched: 2022-12-13_13:33:47.499335) 13:33:51.031345 run osmo-hlr_10.42.42.2(pid=26768): stderr: | 20221213133347696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133347696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133347696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133347696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133347696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133347696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133347709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133347717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133347718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133347718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:51.084041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26763): Terminating (SIGTERM) 13:33:51.126402 run iperf3-srv_10.42.42.10(pid=26764): Terminating (SIGTERM) 13:33:51.168073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26767): Terminating (SIGTERM) 13:33:51.210253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26770): Terminating (SIGTERM) 13:33:51.252023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26773): Terminating (SIGTERM) 13:33:51.293868 --- ParallelTerminationStrategy: PID 26763 died... 13:33:51.313955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26763): Terminated: ok {rc=0} 13:33:51.359875 --- ParallelTerminationStrategy: PID 26764 died... 13:33:51.379334 run iperf3-srv_10.42.42.10(pid=26764): Terminated {rc=256} 13:33:51.425059 --- ParallelTerminationStrategy: PID 26767 died... 13:33:51.444522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26767): Terminated: ok {rc=0} 13:33:51.490438 --- ParallelTerminationStrategy: PID 26770 died... 13:33:51.510176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26770): Terminated: ok {rc=0} 13:33:51.555960 --- ParallelTerminationStrategy: PID 26773 died... 13:33:51.575606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26773): Terminated: ok {rc=0} 13:33:51.663192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:33:52.813344 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:52.825449 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:33:52.879175 tst iperf3m4.py: using LAC 34287 13:33:53.007511 tst iperf3m4.py: using RAC 117 13:33:53.141115 tst iperf3m4.py: using CellId 34287 13:33:53.269362 tst iperf3m4.py: using BVCI 34288 13:33:53.388689 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.400348 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.411635 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.423055 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.435059 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.447123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.459499 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.471579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:53.483795 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:53.605610 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:53.728812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:53.850143 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:53.967965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:54.173701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:54.479543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26775): Launched 13:33:54.746135 run iperf3-srv_10.42.42.10(pid=26776): Launched 13:33:54.863538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:33:55.068878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:55.376830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26777): Launched 13:33:55.643480 run iperf3-srv_10.42.42.10(pid=26778): Launched 13:33:55.758792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:33:55.963451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:56.270274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26779): Launched 13:33:56.538246 run iperf3-srv_10.42.42.10(pid=26780): Launched 13:33:56.655357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:33:56.859985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:57.166872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26781): Launched 13:33:57.437177 run iperf3-srv_10.42.42.10(pid=26782): Launched 13:33:57.553452 tst iperf3m4.py:8: start network... 13:33:57.758220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:58.231653 run create_hlr_db(pid=26783): Launched 13:33:58.357354 bus /gobi_6: Setting Powered False 13:33:59.418118 run create_hlr_db(pid=26783): Terminated: ok {rc=0} 13:33:59.843901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26785): Launched 13:34:00.150468 run osmo-hlr_10.42.42.2(pid=26786): Launched 13:34:00.267770 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:00.807928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26788): Launched 13:34:01.131797 run osmo-stp_10.42.42.5(pid=26789): Launched 13:34:01.499819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:02.113685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26791): Launched 13:34:02.237672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:02.497379 run patchelf(pid=26792): Launched 13:34:02.668283 run osmo-stp_10.42.42.5(pid=26789): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26789)] 13:34:02.797971 run osmo-stp_10.42.42.5(pid=26789): stdout: | (launched: 2022-12-13_13:34:01.073624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:02.929495 run osmo-stp_10.42.42.5(pid=26789): stderr: | 20221213133401367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133401367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133401367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133401368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133401368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133401368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133401368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:03.060936 run osmo-stp_10.42.42.5(pid=26789): stdout: | (launched: 2022-12-13_13:34:01.073624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:03.186755 run osmo-stp_10.42.42.5(pid=26789): stderr: | 20221213133401367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133401367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133401367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133401368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133401368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133401368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133401368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:03.335691 run patchelf(pid=26792): Terminating (SIGINT) 13:34:03.508494 run patchelf(pid=26792): Terminated: ok {rc=0} 13:34:03.633330 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26789): Process ended prematurely: osmo-stp_10.42.42.5(pid=26789) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26789)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 13:34:03.642753 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:34:03.669925 run osmo-hlr_10.42.42.2(pid=26786): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26786)] 13:34:03.717013 run osmo-hlr_10.42.42.2(pid=26786): stdout: | (launched: 2022-12-13_13:34:00.093771) 13:34:03.765754 run osmo-hlr_10.42.42.2(pid=26786): stderr: | 20221213133400267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133400267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133400267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133400268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133400268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133400268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133400280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133400288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133400288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133400288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:03.815445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26775): Terminating (SIGTERM) 13:34:03.854814 run iperf3-srv_10.42.42.10(pid=26776): Terminating (SIGTERM) 13:34:03.893979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26777): Terminating (SIGTERM) 13:34:03.933362 run iperf3-srv_10.42.42.10(pid=26778): Terminating (SIGTERM) 13:34:03.972399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26779): Terminating (SIGTERM) 13:34:04.011555 run iperf3-srv_10.42.42.10(pid=26780): Terminating (SIGTERM) 13:34:04.050574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26781): Terminating (SIGTERM) 13:34:04.089817 run iperf3-srv_10.42.42.10(pid=26782): Terminating (SIGTERM) 13:34:04.128743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26785): Terminating (SIGTERM) 13:34:04.168071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26788): Terminating (SIGTERM) 13:34:04.207777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26791): Terminating (SIGTERM) 13:34:04.247369 --- ParallelTerminationStrategy: PID 26775 died... 13:34:04.266471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26775): Terminated: ok {rc=0} 13:34:04.310027 --- ParallelTerminationStrategy: PID 26776 died... 13:34:04.328554 run iperf3-srv_10.42.42.10(pid=26776): Terminated {rc=256} 13:34:04.372437 --- ParallelTerminationStrategy: PID 26777 died... 13:34:04.391156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26777): Terminated: ok {rc=0} 13:34:04.434437 --- ParallelTerminationStrategy: PID 26778 died... 13:34:04.452891 run iperf3-srv_10.42.42.10(pid=26778): Terminated {rc=256} 13:34:04.496050 --- ParallelTerminationStrategy: PID 26779 died... 13:34:04.514594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26779): Terminated: ok {rc=0} 13:34:04.557849 --- ParallelTerminationStrategy: PID 26780 died... 13:34:04.576755 run iperf3-srv_10.42.42.10(pid=26780): Terminated {rc=256} 13:34:04.619654 --- ParallelTerminationStrategy: PID 26781 died... 13:34:04.638075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26781): Terminated: ok {rc=0} 13:34:04.681191 --- ParallelTerminationStrategy: PID 26782 died... 13:34:04.699513 run iperf3-srv_10.42.42.10(pid=26782): Terminated {rc=256} 13:34:04.742635 --- ParallelTerminationStrategy: PID 26785 died... 13:34:04.761090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26785): Terminated: ok {rc=0} 13:34:04.803979 --- ParallelTerminationStrategy: PID 26788 died... 13:34:04.822620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26788): Terminated: ok {rc=0} 13:34:04.865793 --- ParallelTerminationStrategy: PID 26791 died... 13:34:04.884305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26791): Terminated: ok {rc=0} 13:34:04.969324 bus /gobi_4: Setting Powered False 13:34:06.068581 bus /gobi_4: Setting Powered False 13:34:07.181946 bus /gobi_1: Setting Powered False 13:34:08.279193 bus /gobi_1: Setting Powered False 13:34:09.393725 bus /gobi_0: Setting Powered False 13:34:10.491431 bus /gobi_0: Setting Powered False 13:34:11.610454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 13:34:12.712107 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:12.723871 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:34:12.774433 tst ping.py: using LAC 34288 13:34:12.893813 tst ping.py: using RAC 118 13:34:13.014338 tst ping.py: using CellId 34288 13:34:13.133676 tst ping.py: using BVCI 34289 13:34:13.241778 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.252679 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.263538 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.274408 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.285132 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.296188 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.307096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:13.317948 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:13.435533 tst ping.py:19: start network... 13:34:13.652580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:14.151136 run create_hlr_db(pid=26793): Launched 13:34:14.275300 bus /gobi_6: Setting Powered False 13:34:15.338660 run create_hlr_db(pid=26793): Terminated: ok {rc=0} 13:34:15.787283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Launched 13:34:16.164039 run osmo-hlr_10.42.42.2(pid=26796): Launched 13:34:16.343565 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:16.990775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Launched 13:34:17.318765 run osmo-stp_10.42.42.5(pid=26799): Launched 13:34:17.507438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:18.025671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26801): Launched 13:34:18.140554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:18.394791 run patchelf(pid=26802): Launched 13:34:18.563355 run osmo-stp_10.42.42.5(pid=26799): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] 13:34:18.690300 run osmo-stp_10.42.42.5(pid=26799): stdout: | (launched: 2022-12-13_13:34:17.257938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:18.819063 run osmo-stp_10.42.42.5(pid=26799): stderr: | 20221213133417459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133417459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133417459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133417459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133417460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133417460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133417460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:18.947578 run osmo-stp_10.42.42.5(pid=26799): stdout: | (launched: 2022-12-13_13:34:17.257938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:19.070146 run osmo-stp_10.42.42.5(pid=26799): stderr: | 20221213133417459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133417459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133417459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133417459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133417460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133417460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133417460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:19.215102 run patchelf(pid=26802): Terminating (SIGINT) 13:34:19.383793 run patchelf(pid=26802): Terminated: ok {rc=0} 13:34:19.505568 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26799): Process ended prematurely: osmo-stp_10.42.42.5(pid=26799) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 13:34:19.514470 tst ping.py:22: Test FAILED (6.8 sec) 13:34:19.540737 run osmo-hlr_10.42.42.2(pid=26796): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26796)] 13:34:19.588709 run osmo-hlr_10.42.42.2(pid=26796): stdout: | (launched: 2022-12-13_13:34:16.105280) 13:34:19.637790 run osmo-hlr_10.42.42.2(pid=26796): stderr: | 20221213133416419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133416419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133416419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133416419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133416419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133416419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133416437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133416450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133416450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133416450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:19.687086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Terminating (SIGTERM) 13:34:19.727540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Terminating (SIGTERM) 13:34:19.767211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26801): Terminating (SIGTERM) 13:34:19.807039 --- ParallelTerminationStrategy: PID 26795 died... 13:34:19.826317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Terminated: ok {rc=0} 13:34:19.870206 --- ParallelTerminationStrategy: PID 26798 died... 13:34:19.888760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Terminated: ok {rc=0} 13:34:19.932364 --- ParallelTerminationStrategy: PID 26801 died... 13:34:19.951064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26801): Terminated: ok {rc=0} 13:34:20.036258 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:34:21.124651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.136376 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:34:21.187688 tst ping_idle_ping.py: using LAC 34289 13:34:21.305506 tst ping_idle_ping.py: using RAC 119 13:34:21.433749 tst ping_idle_ping.py: using CellId 34289 13:34:21.562771 tst ping_idle_ping.py: using BVCI 34290 13:34:21.672404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.683593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.694528 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.705592 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.716400 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.727328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.738473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:21.749353 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:21.866237 tst ping_idle_ping.py:24: start network... 13:34:22.067615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:22.536926 run create_hlr_db(pid=26803): Launched 13:34:22.660227 bus /gobi_6: Setting Powered False 13:34:23.720008 run create_hlr_db(pid=26803): Terminated: ok {rc=0} 13:34:24.162899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26805): Launched 13:34:24.487023 run osmo-hlr_10.42.42.2(pid=26806): Launched 13:34:24.612040 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:25.172710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26808): Launched 13:34:25.494350 run osmo-stp_10.42.42.5(pid=26809): Launched 13:34:25.618057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:26.174878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26811): Launched 13:34:26.299757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:26.573483 run patchelf(pid=26812): Launched 13:34:26.755020 run osmo-stp_10.42.42.5(pid=26809): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26809)] 13:34:26.892339 run osmo-stp_10.42.42.5(pid=26809): stdout: | (launched: 2022-12-13_13:34:25.435486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:27.031642 run osmo-stp_10.42.42.5(pid=26809): stderr: | 20221213133425623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133425623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133425623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133425624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133425624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133425624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133425624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:27.171582 run osmo-stp_10.42.42.5(pid=26809): stdout: | (launched: 2022-12-13_13:34:25.435486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:27.305037 run osmo-stp_10.42.42.5(pid=26809): stderr: | 20221213133425623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133425623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133425623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133425624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133425624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133425624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133425624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:27.462676 run patchelf(pid=26812): Terminating (SIGINT) 13:34:27.644833 run patchelf(pid=26812): Terminated: ok {rc=0} 13:34:27.776427 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26809): Process ended prematurely: osmo-stp_10.42.42.5(pid=26809) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26809)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 13:34:27.786148 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:34:27.814145 run osmo-hlr_10.42.42.2(pid=26806): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26806)] 13:34:27.864923 run osmo-hlr_10.42.42.2(pid=26806): stdout: | (launched: 2022-12-13_13:34:24.427826) 13:34:27.916758 run osmo-hlr_10.42.42.2(pid=26806): stderr: | 20221213133424622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133424622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133424622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133424622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133424622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133424622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133424634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133424643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133424643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133424643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:27.968895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26805): Terminating (SIGTERM) 13:34:28.010918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26808): Terminating (SIGTERM) 13:34:28.053032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26811): Terminating (SIGTERM) 13:34:28.096159 --- ParallelTerminationStrategy: PID 26805 died... 13:34:28.116919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26805): Terminated: ok {rc=0} 13:34:28.163631 --- ParallelTerminationStrategy: PID 26808 died... 13:34:28.183942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26808): Terminated: ok {rc=0} 13:34:28.230804 --- ParallelTerminationStrategy: PID 26811 died... 13:34:28.251153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26811): Terminated: ok {rc=0} 13:34:28.340855 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:34:29.655118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:29.661824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:34:29.697503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:34:29.737224 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:34:29.826207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:34:29.860480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:34:29.900284 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:34:30.499872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:34:30.552524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:30.564029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:34:30.643479 tst cs_paging_gprs_active.py: using LAC 34290 13:34:30.782776 tst cs_paging_gprs_active.py: using RAC 120 13:34:30.935537 tst cs_paging_gprs_active.py: using CellId 34290 13:34:31.063852 tst cs_paging_gprs_active.py: using BVCI 34291 13:34:31.187185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.199597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.212150 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.224549 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.238146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.251820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.265371 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.278520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:31.291959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:31.418727 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:31.542841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:34:31.770086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:32.135024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Launched 13:34:32.433637 run iperf3-srv_10.42.42.10(pid=26817): Launched 13:34:32.557242 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:34:32.778333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:33.108525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Launched 13:34:33.393642 run iperf3-srv_10.42.42.10(pid=26819): Launched 13:34:33.517223 tst cs_paging_gprs_active.py:38: start network... 13:34:33.738576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:34.248902 run create_hlr_db(pid=26820): Launched 13:34:34.374584 bus /gobi_6: Setting Powered False 13:34:35.438572 run create_hlr_db(pid=26820): Terminated: ok {rc=0} 13:34:35.876726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26823): Launched 13:34:36.182704 run osmo-hlr_10.42.42.2(pid=26824): Launched 13:34:36.298686 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:36.824415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Launched 13:34:37.131539 run osmo-stp_10.42.42.5(pid=26827): Launched 13:34:37.247759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:37.775083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Launched 13:34:37.893418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:38.152526 run patchelf(pid=26830): Launched 13:34:38.322849 run osmo-stp_10.42.42.5(pid=26827): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] 13:34:38.452163 run osmo-stp_10.42.42.5(pid=26827): stdout: | (launched: 2022-12-13_13:34:37.074290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:38.583164 run osmo-stp_10.42.42.5(pid=26827): stderr: | 20221213133437243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133437244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133437244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133437244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133437245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133437245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133437245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:38.714004 run osmo-stp_10.42.42.5(pid=26827): stdout: | (launched: 2022-12-13_13:34:37.074290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:38.838878 run osmo-stp_10.42.42.5(pid=26827): stderr: | 20221213133437243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133437244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133437244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133437244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133437245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133437245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133437245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:38.986674 run patchelf(pid=26830): Terminating (SIGINT) 13:34:39.157804 run patchelf(pid=26830): Terminated: ok {rc=0} 13:34:39.281358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26827): Process ended prematurely: osmo-stp_10.42.42.5(pid=26827) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:34:39.290964 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:34:39.317721 run osmo-hlr_10.42.42.2(pid=26824): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26824)] 13:34:39.364568 run osmo-hlr_10.42.42.2(pid=26824): stdout: | (launched: 2022-12-13_13:34:36.126336) 13:34:39.413137 run osmo-hlr_10.42.42.2(pid=26824): stderr: | 20221213133436299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133436299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133436299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133436299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133436299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133436299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133436312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133436320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133436320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133436320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:39.462093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Terminating (SIGTERM) 13:34:39.501454 run iperf3-srv_10.42.42.10(pid=26817): Terminating (SIGTERM) 13:34:39.540480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Terminating (SIGTERM) 13:34:39.579723 run iperf3-srv_10.42.42.10(pid=26819): Terminating (SIGTERM) 13:34:39.618916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26823): Terminating (SIGTERM) 13:34:39.658121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Terminating (SIGTERM) 13:34:39.697457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Terminating (SIGTERM) 13:34:39.737472 --- ParallelTerminationStrategy: PID 26816 died... 13:34:39.756326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Terminated: ok {rc=0} 13:34:39.799628 --- ParallelTerminationStrategy: PID 26817 died... 13:34:39.818080 run iperf3-srv_10.42.42.10(pid=26817): Terminated {rc=256} 13:34:39.861582 --- ParallelTerminationStrategy: PID 26818 died... 13:34:39.879926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Terminated: ok {rc=0} 13:34:39.923474 --- ParallelTerminationStrategy: PID 26819 died... 13:34:39.941804 run iperf3-srv_10.42.42.10(pid=26819): Terminated {rc=256} 13:34:39.984855 --- ParallelTerminationStrategy: PID 26823 died... 13:34:40.003699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26823): Terminated: ok {rc=0} 13:34:40.046714 --- ParallelTerminationStrategy: PID 26826 died... 13:34:40.065281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Terminated: ok {rc=0} 13:34:40.108443 --- ParallelTerminationStrategy: PID 26829 died... 13:34:40.126783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Terminated: ok {rc=0} 13:34:40.211626 bus /gobi_0: Setting Powered False 13:34:41.311360 bus /gobi_0: Setting Powered False 13:34:42.428032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:34:43.577207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:43.589637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:34:43.665394 tst iperf3.py: using LAC 34291 13:34:43.785442 tst iperf3.py: using RAC 121 13:34:43.915151 tst iperf3.py: using CellId 34291 13:34:44.047365 tst iperf3.py: using BVCI 34292 13:34:44.167071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.178827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.190419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.201916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.213609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.225272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.237567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.249306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:44.261213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:44.381994 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:44.603557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:44.931171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26831): Launched 13:34:45.217965 run iperf3-srv_10.42.42.10(pid=26832): Launched 13:34:45.343067 tst iperf3.py:8: start network... 13:34:45.563044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:46.075433 run create_hlr_db(pid=26833): Launched 13:34:46.232331 bus /gobi_6: Setting Powered False 13:34:47.292119 run create_hlr_db(pid=26833): Terminated: ok {rc=0} 13:34:47.735955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26835): Launched 13:34:48.043975 run osmo-hlr_10.42.42.2(pid=26836): Launched 13:34:48.160706 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:48.704125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26838): Launched 13:34:49.009452 run osmo-stp_10.42.42.5(pid=26839): Launched 13:34:49.125887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:49.655809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26841): Launched 13:34:49.772765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:50.031509 run patchelf(pid=26842): Launched 13:34:50.202029 run osmo-stp_10.42.42.5(pid=26839): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26839)] 13:34:50.330927 run osmo-stp_10.42.42.5(pid=26839): stdout: | (launched: 2022-12-13_13:34:48.953276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:50.462843 run osmo-stp_10.42.42.5(pid=26839): stderr: | 20221213133449119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133449119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133449119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133449120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133449120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133449120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133449120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:50.593690 run osmo-stp_10.42.42.5(pid=26839): stdout: | (launched: 2022-12-13_13:34:48.953276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:50.718650 run osmo-stp_10.42.42.5(pid=26839): stderr: | 20221213133449119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133449119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133449119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133449120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133449120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133449120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133449120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:50.866900 run patchelf(pid=26842): Terminating (SIGINT) 13:34:51.039411 run patchelf(pid=26842): Terminated: ok {rc=0} 13:34:51.163635 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26839): Process ended prematurely: osmo-stp_10.42.42.5(pid=26839) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26839)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 13:34:51.173143 tst iperf3.py:8: Test FAILED (7.6 sec) 13:34:51.199942 run osmo-hlr_10.42.42.2(pid=26836): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26836)] 13:34:51.246865 run osmo-hlr_10.42.42.2(pid=26836): stdout: | (launched: 2022-12-13_13:34:47.987022) 13:34:51.295347 run osmo-hlr_10.42.42.2(pid=26836): stderr: | 20221213133448162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133448162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133448162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133448162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133448162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133448162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133448175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133448183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133448183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133448183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:51.345164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26831): Terminating (SIGTERM) 13:34:51.384300 run iperf3-srv_10.42.42.10(pid=26832): Terminating (SIGTERM) 13:34:51.423398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26835): Terminating (SIGTERM) 13:34:51.462835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26838): Terminating (SIGTERM) 13:34:51.502009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26841): Terminating (SIGTERM) 13:34:51.541457 --- ParallelTerminationStrategy: PID 26831 died... 13:34:51.560278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26831): Terminated: ok {rc=0} 13:34:51.603693 --- ParallelTerminationStrategy: PID 26832 died... 13:34:51.622027 run iperf3-srv_10.42.42.10(pid=26832): Terminated {rc=256} 13:34:51.665131 --- ParallelTerminationStrategy: PID 26835 died... 13:34:51.683537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26835): Terminated: ok {rc=0} 13:34:51.726938 --- ParallelTerminationStrategy: PID 26838 died... 13:34:51.745332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26838): Terminated: ok {rc=0} 13:34:51.788417 --- ParallelTerminationStrategy: PID 26841 died... 13:34:51.806944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26841): Terminated: ok {rc=0} 13:34:51.892115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:34:53.039217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.051029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:34:53.123574 tst iperf3m4.py: using LAC 34292 13:34:53.245454 tst iperf3m4.py: using RAC 122 13:34:53.368573 tst iperf3m4.py: using CellId 34292 13:34:53.490508 tst iperf3m4.py: using BVCI 34293 13:34:53.603519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.614714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.625689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.636521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.647877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.659380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.671081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.682523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:53.694029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:53.816404 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:53.937644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:54.057554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:54.174395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:54.379827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:54.687056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26843): Launched 13:34:54.953776 run iperf3-srv_10.42.42.10(pid=26844): Launched 13:34:55.069636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:34:55.276628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:55.586645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26845): Launched 13:34:55.852607 run iperf3-srv_10.42.42.10(pid=26846): Launched 13:34:55.967613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:34:56.173682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:56.481178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26847): Launched 13:34:56.748181 run iperf3-srv_10.42.42.10(pid=26848): Launched 13:34:56.864029 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:34:57.069711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:57.377485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26849): Launched 13:34:57.646213 run iperf3-srv_10.42.42.10(pid=26850): Launched 13:34:57.760856 tst iperf3m4.py:8: start network... 13:34:57.965931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:58.440099 run create_hlr_db(pid=26851): Launched 13:34:58.566014 bus /gobi_6: Setting Powered False 13:34:59.627371 run create_hlr_db(pid=26851): Terminated: ok {rc=0} 13:35:00.054347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Launched 13:35:00.361227 run osmo-hlr_10.42.42.2(pid=26854): Launched 13:35:00.477223 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:01.059330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Launched 13:35:01.387190 run osmo-stp_10.42.42.5(pid=26857): Launched 13:35:01.714796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:02.328382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26862): Launched 13:35:02.473873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:02.751649 run patchelf(pid=26863): Launched 13:35:02.933917 run osmo-stp_10.42.42.5(pid=26857): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] 13:35:03.071952 run osmo-stp_10.42.42.5(pid=26857): stdout: | (launched: 2022-12-13_13:35:01.328593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:03.212619 run osmo-stp_10.42.42.5(pid=26857): stderr: | 20221213133501631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133501631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133501632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133501633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133501634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133501634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133501634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:03.352663 run osmo-stp_10.42.42.5(pid=26857): stdout: | (launched: 2022-12-13_13:35:01.328593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:03.487219 run osmo-stp_10.42.42.5(pid=26857): stderr: | 20221213133501631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133501631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133501632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133501633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133501634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133501634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133501634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:03.646289 run patchelf(pid=26863): Terminating (SIGINT) 13:35:03.830087 run patchelf(pid=26863): Terminated: ok {rc=0} 13:35:03.962217 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26857): Process ended prematurely: osmo-stp_10.42.42.5(pid=26857) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:35:03.972548 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:35:04.001220 run osmo-hlr_10.42.42.2(pid=26854): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26854)] 13:35:04.051615 run osmo-hlr_10.42.42.2(pid=26854): stdout: | (launched: 2022-12-13_13:35:00.304396) 13:35:04.103901 run osmo-hlr_10.42.42.2(pid=26854): stderr: | 20221213133500480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133500480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133500480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133500480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133500480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133500480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133500493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133500502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133500502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133500502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:04.156239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26843): Terminating (SIGTERM) 13:35:04.198480 run iperf3-srv_10.42.42.10(pid=26844): Terminating (SIGTERM) 13:35:04.240556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26845): Terminating (SIGTERM) 13:35:04.282744 run iperf3-srv_10.42.42.10(pid=26846): Terminating (SIGTERM) 13:35:04.325061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26847): Terminating (SIGTERM) 13:35:04.367400 run iperf3-srv_10.42.42.10(pid=26848): Terminating (SIGTERM) 13:35:04.409757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26849): Terminating (SIGTERM) 13:35:04.451638 run iperf3-srv_10.42.42.10(pid=26850): Terminating (SIGTERM) 13:35:04.493400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Terminating (SIGTERM) 13:35:04.535146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Terminating (SIGTERM) 13:35:04.576783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26862): Terminating (SIGTERM) 13:35:04.619112 --- ParallelTerminationStrategy: PID 26843 died... 13:35:04.639221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26843): Terminated: ok {rc=0} 13:35:04.685203 --- ParallelTerminationStrategy: PID 26844 died... 13:35:04.704729 run iperf3-srv_10.42.42.10(pid=26844): Terminated {rc=256} 13:35:04.750256 --- ParallelTerminationStrategy: PID 26845 died... 13:35:04.769819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26845): Terminated: ok {rc=0} 13:35:04.815606 --- ParallelTerminationStrategy: PID 26846 died... 13:35:04.835157 run iperf3-srv_10.42.42.10(pid=26846): Terminated {rc=256} 13:35:04.880614 --- ParallelTerminationStrategy: PID 26847 died... 13:35:04.900207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26847): Terminated: ok {rc=0} 13:35:04.946156 --- ParallelTerminationStrategy: PID 26848 died... 13:35:04.965784 run iperf3-srv_10.42.42.10(pid=26848): Terminated {rc=256} 13:35:05.011365 --- ParallelTerminationStrategy: PID 26849 died... 13:35:05.030972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26849): Terminated: ok {rc=0} 13:35:05.077449 --- ParallelTerminationStrategy: PID 26850 died... 13:35:05.096870 run iperf3-srv_10.42.42.10(pid=26850): Terminated {rc=256} 13:35:05.142716 --- ParallelTerminationStrategy: PID 26853 died... 13:35:05.162364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Terminated: ok {rc=0} 13:35:05.208178 --- ParallelTerminationStrategy: PID 26856 died... 13:35:05.227728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Terminated: ok {rc=0} 13:35:05.273602 --- ParallelTerminationStrategy: PID 26862 died... 13:35:05.293314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26862): Terminated: ok {rc=0} 13:35:05.380712 bus /gobi_4: Setting Powered False 13:35:06.478917 bus /gobi_4: Setting Powered False 13:35:07.592420 bus /gobi_1: Setting Powered False 13:35:08.691052 bus /gobi_1: Setting Powered False 13:35:09.806027 bus /gobi_0: Setting Powered False 13:35:10.904384 bus /gobi_0: Setting Powered False 13:35:12.017549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:35:13.116522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.128254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:35:13.200286 tst ping.py: using LAC 34293 13:35:13.318439 tst ping.py: using RAC 123 13:35:13.437378 tst ping.py: using CellId 34293 13:35:13.554865 tst ping.py: using BVCI 34294 13:35:13.665271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.676420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.687484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.698501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.709946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.721472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.733120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:13.744470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:13.861987 tst ping.py:19: start network... 13:35:14.061675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:14.524667 run create_hlr_db(pid=26865): Launched 13:35:14.647094 bus /gobi_6: Setting Powered False 13:35:15.707664 run create_hlr_db(pid=26865): Terminated: ok {rc=0} 13:35:16.166508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Launched 13:35:16.528036 run osmo-hlr_10.42.42.2(pid=26868): Launched 13:35:16.765551 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:17.454943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Launched 13:35:17.753507 run osmo-stp_10.42.42.5(pid=26871): Launched 13:35:17.868194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:18.389220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Launched 13:35:18.503376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:18.756427 run patchelf(pid=26874): Launched 13:35:18.923395 run osmo-stp_10.42.42.5(pid=26871): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] 13:35:19.050150 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-13_13:35:17.698613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:19.179784 run osmo-stp_10.42.42.5(pid=26871): stderr: | 20221213133517864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133517865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133517865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133517865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133517866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133517866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133517866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:19.308073 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-13_13:35:17.698613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:19.430622 run osmo-stp_10.42.42.5(pid=26871): stderr: | 20221213133517864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133517865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133517865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133517865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133517866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133517866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133517866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:19.575853 run patchelf(pid=26874): Terminating (SIGINT) 13:35:19.743909 run patchelf(pid=26874): Terminated: ok {rc=0} 13:35:19.865108 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 13:35:19.873968 tst ping.py:22: Test FAILED (6.8 sec) 13:35:19.900775 run osmo-hlr_10.42.42.2(pid=26868): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26868)] 13:35:19.948639 run osmo-hlr_10.42.42.2(pid=26868): stdout: | (launched: 2022-12-13_13:35:16.470968) 13:35:19.998165 run osmo-hlr_10.42.42.2(pid=26868): stderr: | 20221213133516796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133516796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133516796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133516796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133516796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133516796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133516823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133516840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133516840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133516840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:20.047978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminating (SIGTERM) 13:35:20.088095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminating (SIGTERM) 13:35:20.128374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Terminating (SIGTERM) 13:35:20.168642 --- ParallelTerminationStrategy: PID 26867 died... 13:35:20.188311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminated: ok {rc=0} 13:35:20.232530 --- ParallelTerminationStrategy: PID 26870 died... 13:35:20.251289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminated: ok {rc=0} 13:35:20.295279 --- ParallelTerminationStrategy: PID 26873 died... 13:35:20.313972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26873): Terminated: ok {rc=0} 13:35:20.398850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:35:21.488282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:21.501266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:35:21.580313 tst ping_idle_ping.py: using LAC 34294 13:35:21.701703 tst ping_idle_ping.py: using RAC 124 13:35:21.829767 tst ping_idle_ping.py: using CellId 34294 13:35:21.956877 tst ping_idle_ping.py: using BVCI 34295 13:35:22.075702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.088109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.099829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.111437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.123114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.134876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.146848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:22.158762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:22.280165 tst ping_idle_ping.py:24: start network... 13:35:22.498698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:23.006585 run create_hlr_db(pid=26875): Launched 13:35:23.131447 bus /gobi_6: Setting Powered False 13:35:24.195399 run create_hlr_db(pid=26875): Terminated: ok {rc=0} 13:35:24.646071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26877): Launched 13:35:24.969906 run osmo-hlr_10.42.42.2(pid=26878): Launched 13:35:25.094588 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:25.659678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26880): Launched 13:35:25.981696 run osmo-stp_10.42.42.5(pid=26881): Launched 13:35:26.105950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:26.661001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26883): Launched 13:35:26.783932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:27.055763 run patchelf(pid=26884): Launched 13:35:27.235263 run osmo-stp_10.42.42.5(pid=26881): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26881)] 13:35:27.372126 run osmo-stp_10.42.42.5(pid=26881): stdout: | (launched: 2022-12-13_13:35:25.922956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:27.510896 run osmo-stp_10.42.42.5(pid=26881): stderr: | 20221213133526111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133526111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133526111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133526112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133526112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133526112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133526112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:27.649513 run osmo-stp_10.42.42.5(pid=26881): stdout: | (launched: 2022-12-13_13:35:25.922956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:27.781458 run osmo-stp_10.42.42.5(pid=26881): stderr: | 20221213133526111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133526111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133526111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133526112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133526112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133526112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133526112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:27.938003 run patchelf(pid=26884): Terminating (SIGINT) 13:35:28.119720 run patchelf(pid=26884): Terminated: ok {rc=0} 13:35:28.250635 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26881): Process ended prematurely: osmo-stp_10.42.42.5(pid=26881) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26881)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:35:28.260238 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:35:28.288315 run osmo-hlr_10.42.42.2(pid=26878): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26878)] 13:35:28.339022 run osmo-hlr_10.42.42.2(pid=26878): stdout: | (launched: 2022-12-13_13:35:24.911172) 13:35:28.391204 run osmo-hlr_10.42.42.2(pid=26878): stderr: | 20221213133525106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133525106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133525106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133525106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133525106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133525106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133525118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133525127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133525127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133525127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:28.443672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26877): Terminating (SIGTERM) 13:35:28.486226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26880): Terminating (SIGTERM) 13:35:28.529338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26883): Terminating (SIGTERM) 13:35:28.572042 --- ParallelTerminationStrategy: PID 26877 died... 13:35:28.592464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26877): Terminated: ok {rc=0} 13:35:28.639426 --- ParallelTerminationStrategy: PID 26880 died... 13:35:28.659381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26880): Terminated: ok {rc=0} 13:35:28.705308 --- ParallelTerminationStrategy: PID 26883 died... 13:35:28.725067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26883): Terminated: ok {rc=0} 13:35:28.812510 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:35:30.120869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:35:30.127703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:35:30.162371 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:35:30.203656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:35:30.299953 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:35:30.334595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:35:30.374161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:35:30.978333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:35:31.041120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.053192 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:35:31.125829 tst cs_paging_gprs_active.py: using LAC 34295 13:35:31.294886 tst cs_paging_gprs_active.py: using RAC 125 13:35:31.421075 tst cs_paging_gprs_active.py: using CellId 34295 13:35:31.546070 tst cs_paging_gprs_active.py: using BVCI 34296 13:35:31.661873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.673944 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.685547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.697098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.708432 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.719823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.731363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.742752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:31.754378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:31.895669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:32.042665 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:35:32.271757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:32.584595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26889): Launched 13:35:32.851701 run iperf3-srv_10.42.42.10(pid=26890): Launched 13:35:32.968930 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:35:33.173251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:33.479903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26891): Launched 13:35:33.746384 run iperf3-srv_10.42.42.10(pid=26892): Launched 13:35:33.860879 tst cs_paging_gprs_active.py:38: start network... 13:35:34.065638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:34.540108 run create_hlr_db(pid=26893): Launched 13:35:34.666113 bus /gobi_6: Setting Powered False 13:35:35.726063 run create_hlr_db(pid=26893): Terminated: ok {rc=0} 13:35:36.172050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Launched 13:35:36.499340 run osmo-hlr_10.42.42.2(pid=26896): Launched 13:35:36.626362 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:37.192543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Launched 13:35:37.520418 run osmo-stp_10.42.42.5(pid=26899): Launched 13:35:37.645750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:38.210961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26901): Launched 13:35:38.337334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:38.614083 run patchelf(pid=26902): Launched 13:35:38.795794 run osmo-stp_10.42.42.5(pid=26899): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] 13:35:38.934202 run osmo-stp_10.42.42.5(pid=26899): stdout: | (launched: 2022-12-13_13:35:37.460375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:39.073815 run osmo-stp_10.42.42.5(pid=26899): stderr: | 20221213133537650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133537650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133537650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133537651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133537651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133537651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133537651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:39.214647 run osmo-stp_10.42.42.5(pid=26899): stdout: | (launched: 2022-12-13_13:35:37.460375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:39.348746 run osmo-stp_10.42.42.5(pid=26899): stderr: | 20221213133537650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133537650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133537650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133537651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133537651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133537651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133537651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:39.507373 run patchelf(pid=26902): Terminating (SIGINT) 13:35:39.690276 run patchelf(pid=26902): Terminated: ok {rc=0} 13:35:39.822505 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26899): Process ended prematurely: osmo-stp_10.42.42.5(pid=26899) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:35:39.832692 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:35:39.860845 run osmo-hlr_10.42.42.2(pid=26896): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26896)] 13:35:39.911044 run osmo-hlr_10.42.42.2(pid=26896): stdout: | (launched: 2022-12-13_13:35:36.439849) 13:35:39.962468 run osmo-hlr_10.42.42.2(pid=26896): stderr: | 20221213133536635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133536635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133536635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133536635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133536635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133536635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133536646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133536656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133536656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133536656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:40.014276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26889): Terminating (SIGTERM) 13:35:40.056103 run iperf3-srv_10.42.42.10(pid=26890): Terminating (SIGTERM) 13:35:40.098232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26891): Terminating (SIGTERM) 13:35:40.139956 run iperf3-srv_10.42.42.10(pid=26892): Terminating (SIGTERM) 13:35:40.181763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Terminating (SIGTERM) 13:35:40.223798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Terminating (SIGTERM) 13:35:40.265623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26901): Terminating (SIGTERM) 13:35:40.307750 --- ParallelTerminationStrategy: PID 26889 died... 13:35:40.327920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26889): Terminated: ok {rc=0} 13:35:40.374329 --- ParallelTerminationStrategy: PID 26890 died... 13:35:40.394108 run iperf3-srv_10.42.42.10(pid=26890): Terminated {rc=256} 13:35:40.440047 --- ParallelTerminationStrategy: PID 26891 died... 13:35:40.459926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26891): Terminated: ok {rc=0} 13:35:40.505747 --- ParallelTerminationStrategy: PID 26892 died... 13:35:40.525399 run iperf3-srv_10.42.42.10(pid=26892): Terminated {rc=256} 13:35:40.571335 --- ParallelTerminationStrategy: PID 26895 died... 13:35:40.591151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26895): Terminated: ok {rc=0} 13:35:40.637113 --- ParallelTerminationStrategy: PID 26898 died... 13:35:40.656869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26898): Terminated: ok {rc=0} 13:35:40.702767 --- ParallelTerminationStrategy: PID 26901 died... 13:35:40.722549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26901): Terminated: ok {rc=0} 13:35:40.809347 bus /gobi_0: Setting Powered False 13:35:41.908272 bus /gobi_0: Setting Powered False 13:35:43.023149 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:35:44.168536 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.180234 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:35:44.253929 tst iperf3.py: using LAC 34296 13:35:44.379689 tst iperf3.py: using RAC 126 13:35:44.499550 tst iperf3.py: using CellId 34296 13:35:44.618596 tst iperf3.py: using BVCI 34297 13:35:44.730519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.741902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.752698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.763493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.774289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.785058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.795914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.807175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:44.818170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:44.940718 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:45.163017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:45.491786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26903): Launched 13:35:45.777494 run iperf3-srv_10.42.42.10(pid=26904): Launched 13:35:45.936076 tst iperf3.py:8: start network... 13:35:46.152074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:46.645532 run create_hlr_db(pid=26905): Launched 13:35:46.808266 bus /gobi_6: Setting Powered False 13:35:47.869570 run create_hlr_db(pid=26905): Terminated: ok {rc=0} 13:35:48.315763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Launched 13:35:48.644812 run osmo-hlr_10.42.42.2(pid=26908): Launched 13:35:48.768867 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:49.335395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Launched 13:35:49.664171 run osmo-stp_10.42.42.5(pid=26911): Launched 13:35:49.788368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:50.351589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Launched 13:35:50.477443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:50.754063 run patchelf(pid=26914): Launched 13:35:50.937443 run osmo-stp_10.42.42.5(pid=26911): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] 13:35:51.076101 run osmo-stp_10.42.42.5(pid=26911): stdout: | (launched: 2022-12-13_13:35:49.604291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:51.216861 run osmo-stp_10.42.42.5(pid=26911): stderr: | 20221213133549794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133549794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133549795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133549795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133549796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133549796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133549796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:51.357157 run osmo-stp_10.42.42.5(pid=26911): stdout: | (launched: 2022-12-13_13:35:49.604291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:51.491786 run osmo-stp_10.42.42.5(pid=26911): stderr: | 20221213133549794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133549794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133549795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133549795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133549796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133549796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133549796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:51.651414 run patchelf(pid=26914): Terminating (SIGINT) 13:35:51.836242 run patchelf(pid=26914): Terminated: ok {rc=0} 13:35:51.970593 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26911): Process ended prematurely: osmo-stp_10.42.42.5(pid=26911) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 13:35:51.980672 tst iperf3.py:8: Test FAILED (7.8 sec) 13:35:52.009443 run osmo-hlr_10.42.42.2(pid=26908): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26908)] 13:35:52.060260 run osmo-hlr_10.42.42.2(pid=26908): stdout: | (launched: 2022-12-13_13:35:48.584517) 13:35:52.113167 run osmo-hlr_10.42.42.2(pid=26908): stderr: | 20221213133548781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133548781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133548781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133548781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133548781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133548781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133548797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133548807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133548807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133548807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:52.165527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26903): Terminating (SIGTERM) 13:35:52.207791 run iperf3-srv_10.42.42.10(pid=26904): Terminating (SIGTERM) 13:35:52.249971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Terminating (SIGTERM) 13:35:52.292816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Terminating (SIGTERM) 13:35:52.335272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Terminating (SIGTERM) 13:35:52.378335 --- ParallelTerminationStrategy: PID 26903 died... 13:35:52.398756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26903): Terminated: ok {rc=0} 13:35:52.445794 --- ParallelTerminationStrategy: PID 26904 died... 13:35:52.465756 run iperf3-srv_10.42.42.10(pid=26904): Terminated {rc=256} 13:35:52.512145 --- ParallelTerminationStrategy: PID 26907 died... 13:35:52.532008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Terminated: ok {rc=0} 13:35:52.578628 --- ParallelTerminationStrategy: PID 26910 died... 13:35:52.598791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Terminated: ok {rc=0} 13:35:52.645163 --- ParallelTerminationStrategy: PID 26913 died... 13:35:52.664902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Terminated: ok {rc=0} 13:35:52.753877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:35:53.898424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:53.910386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:35:53.981553 tst iperf3m4.py: using LAC 34297 13:35:54.112899 tst iperf3m4.py: using RAC 127 13:35:54.242062 tst iperf3m4.py: using CellId 34297 13:35:54.370802 tst iperf3m4.py: using BVCI 34298 13:35:54.492754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.504498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.516335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.527961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.539825 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.551643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.563633 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.575333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.587488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:54.707252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:54.832888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:54.956551 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:55.075054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:55.281740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:55.589562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26917): Launched 13:35:55.858633 run iperf3-srv_10.42.42.10(pid=26918): Launched 13:35:55.975527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:35:56.181052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:56.488120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Launched 13:35:56.755406 run iperf3-srv_10.42.42.10(pid=26920): Launched 13:35:56.870574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:35:57.075340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:57.382048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Launched 13:35:57.650123 run iperf3-srv_10.42.42.10(pid=26922): Launched 13:35:57.767163 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:35:57.971688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:58.278449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Launched 13:35:58.547229 run iperf3-srv_10.42.42.10(pid=26924): Launched 13:35:58.661807 tst iperf3m4.py:8: start network... 13:35:58.865928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:59.338707 run create_hlr_db(pid=26925): Launched 13:35:59.465308 bus /gobi_6: Setting Powered False 13:36:00.526683 run create_hlr_db(pid=26925): Terminated: ok {rc=0} 13:36:00.977632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Launched 13:36:01.349698 run osmo-hlr_10.42.42.2(pid=26928): Launched 13:36:01.623710 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:02.367556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Launched 13:36:02.685253 run osmo-stp_10.42.42.5(pid=26931): Launched 13:36:02.799895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:03.323317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Launched 13:36:03.441325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:03.699587 run patchelf(pid=26934): Launched 13:36:03.869224 run osmo-stp_10.42.42.5(pid=26931): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] 13:36:03.997899 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-13_13:36:02.628413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:04.128470 run osmo-stp_10.42.42.5(pid=26931): stderr: | 20221213133602797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133602798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133602798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133602798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133602799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133602799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133602799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:04.259071 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-13_13:36:02.628413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:04.383890 run osmo-stp_10.42.42.5(pid=26931): stderr: | 20221213133602797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133602798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133602798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133602798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133602799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133602799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133602799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:04.532194 run patchelf(pid=26934): Terminating (SIGINT) 13:36:04.704030 run patchelf(pid=26934): Terminated: ok {rc=0} 13:36:04.827946 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:36:04.837901 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:36:04.865207 run osmo-hlr_10.42.42.2(pid=26928): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26928)] 13:36:04.912569 run osmo-hlr_10.42.42.2(pid=26928): stdout: | (launched: 2022-12-13_13:36:01.289319) 13:36:04.961670 run osmo-hlr_10.42.42.2(pid=26928): stderr: | 20221213133601521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133601521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133601521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133601521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133601522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133601522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133601535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133601547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133601548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133601548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:05.010913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26917): Terminating (SIGTERM) 13:36:05.050706 run iperf3-srv_10.42.42.10(pid=26918): Terminating (SIGTERM) 13:36:05.090250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Terminating (SIGTERM) 13:36:05.129953 run iperf3-srv_10.42.42.10(pid=26920): Terminating (SIGTERM) 13:36:05.169542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Terminating (SIGTERM) 13:36:05.209122 run iperf3-srv_10.42.42.10(pid=26922): Terminating (SIGTERM) 13:36:05.248517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Terminating (SIGTERM) 13:36:05.288010 run iperf3-srv_10.42.42.10(pid=26924): Terminating (SIGTERM) 13:36:05.327458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminating (SIGTERM) 13:36:05.366985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminating (SIGTERM) 13:36:05.406557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Terminating (SIGTERM) 13:36:05.446329 --- ParallelTerminationStrategy: PID 26917 died... 13:36:05.465462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26917): Terminated: ok {rc=0} 13:36:05.509964 --- ParallelTerminationStrategy: PID 26918 died... 13:36:05.528561 run iperf3-srv_10.42.42.10(pid=26918): Terminated {rc=256} 13:36:05.571992 --- ParallelTerminationStrategy: PID 26919 died... 13:36:05.590713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Terminated: ok {rc=0} 13:36:05.634817 --- ParallelTerminationStrategy: PID 26920 died... 13:36:05.653409 run iperf3-srv_10.42.42.10(pid=26920): Terminated {rc=256} 13:36:05.697101 --- ParallelTerminationStrategy: PID 26921 died... 13:36:05.715780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Terminated: ok {rc=0} 13:36:05.759774 --- ParallelTerminationStrategy: PID 26922 died... 13:36:05.778508 run iperf3-srv_10.42.42.10(pid=26922): Terminated {rc=256} 13:36:05.822138 --- ParallelTerminationStrategy: PID 26923 died... 13:36:05.840750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Terminated: ok {rc=0} 13:36:05.884759 --- ParallelTerminationStrategy: PID 26924 died... 13:36:05.903565 run iperf3-srv_10.42.42.10(pid=26924): Terminated {rc=256} 13:36:05.947341 --- ParallelTerminationStrategy: PID 26927 died... 13:36:05.966020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminated: ok {rc=0} 13:36:06.009663 --- ParallelTerminationStrategy: PID 26930 died... 13:36:06.028244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminated: ok {rc=0} 13:36:06.072233 --- ParallelTerminationStrategy: PID 26933 died... 13:36:06.091267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Terminated: ok {rc=0} 13:36:06.175654 bus /gobi_4: Setting Powered False 13:36:07.270561 bus /gobi_4: Setting Powered False 13:36:08.386671 bus /gobi_1: Setting Powered False 13:36:09.485478 bus /gobi_1: Setting Powered False 13:36:10.601153 bus /gobi_0: Setting Powered False 13:36:11.699995 bus /gobi_0: Setting Powered False 13:36:12.816237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:36:13.919213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:13.931041 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:36:14.002556 tst ping.py: using LAC 34298 13:36:14.121409 tst ping.py: using RAC 128 13:36:14.238237 tst ping.py: using CellId 34298 13:36:14.355584 tst ping.py: using BVCI 34299 13:36:14.464562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.475743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.486642 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.497529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.508333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.519338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.530406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:14.541297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:14.657482 tst ping.py:19: start network... 13:36:14.856820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:15.318899 run create_hlr_db(pid=26935): Launched 13:36:15.441203 bus /gobi_6: Setting Powered False 13:36:16.516150 run create_hlr_db(pid=26935): Terminated: ok {rc=0} 13:36:16.974450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Launched 13:36:17.321819 run osmo-hlr_10.42.42.2(pid=26938): Launched 13:36:17.446612 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:18.011421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26940): Launched 13:36:18.316116 run osmo-stp_10.42.42.5(pid=26941): Launched 13:36:18.429597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:18.946792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26943): Launched 13:36:19.061211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:19.314267 run patchelf(pid=26944): Launched 13:36:19.479907 run osmo-stp_10.42.42.5(pid=26941): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26941)] 13:36:19.606212 run osmo-stp_10.42.42.5(pid=26941): stdout: | (launched: 2022-12-13_13:36:18.260647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.734341 run osmo-stp_10.42.42.5(pid=26941): stderr: | 20221213133618429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133618429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133618430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133618430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133618430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133618431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133618431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:19.862771 run osmo-stp_10.42.42.5(pid=26941): stdout: | (launched: 2022-12-13_13:36:18.260647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.984691 run osmo-stp_10.42.42.5(pid=26941): stderr: | 20221213133618429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133618429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133618430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133618430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133618430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133618431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133618431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:20.129430 run patchelf(pid=26944): Terminating (SIGINT) 13:36:20.297588 run patchelf(pid=26944): Terminated: ok {rc=0} 13:36:20.419098 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26941): Process ended prematurely: osmo-stp_10.42.42.5(pid=26941) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26941)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 13:36:20.427958 tst ping.py:22: Test FAILED (6.5 sec) 13:36:20.454479 run osmo-hlr_10.42.42.2(pid=26938): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26938)] 13:36:20.502109 run osmo-hlr_10.42.42.2(pid=26938): stdout: | (launched: 2022-12-13_13:36:17.263392) 13:36:20.551065 run osmo-hlr_10.42.42.2(pid=26938): stderr: | 20221213133617458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133617458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133617458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133617458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133617458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133617458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133617469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133617477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133617477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133617477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:20.600177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Terminating (SIGTERM) 13:36:20.639715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26940): Terminating (SIGTERM) 13:36:20.679914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26943): Terminating (SIGTERM) 13:36:20.719718 --- ParallelTerminationStrategy: PID 26937 died... 13:36:20.738741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Terminated: ok {rc=0} 13:36:20.782715 --- ParallelTerminationStrategy: PID 26940 died... 13:36:20.801397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26940): Terminated: ok {rc=0} 13:36:20.844894 --- ParallelTerminationStrategy: PID 26943 died... 13:36:20.863798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26943): Terminated: ok {rc=0} 13:36:20.949694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:36:22.038413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.050611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:36:22.121828 tst ping_idle_ping.py: using LAC 34299 13:36:22.247229 tst ping_idle_ping.py: using RAC 129 13:36:22.374455 tst ping_idle_ping.py: using CellId 34299 13:36:22.492401 tst ping_idle_ping.py: using BVCI 34300 13:36:22.602368 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.613505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.624381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.635349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.646127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.656878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.668267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:22.679205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:22.797013 tst ping_idle_ping.py:24: start network... 13:36:22.999584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:23.469763 run create_hlr_db(pid=26945): Launched 13:36:23.593523 bus /gobi_6: Setting Powered False 13:36:24.653978 run create_hlr_db(pid=26945): Terminated: ok {rc=0} 13:36:25.095462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26947): Launched 13:36:25.417661 run osmo-hlr_10.42.42.2(pid=26948): Launched 13:36:25.541846 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:26.096191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Launched 13:36:26.418989 run osmo-stp_10.42.42.5(pid=26951): Launched 13:36:26.541304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:27.098083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Launched 13:36:27.222285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:27.494928 run patchelf(pid=26954): Launched 13:36:27.675679 run osmo-stp_10.42.42.5(pid=26951): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] 13:36:27.812646 run osmo-stp_10.42.42.5(pid=26951): stdout: | (launched: 2022-12-13_13:36:26.359989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:27.951456 run osmo-stp_10.42.42.5(pid=26951): stderr: | 20221213133626546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133626546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133626547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133626547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133626547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133626548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133626548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:28.090296 run osmo-stp_10.42.42.5(pid=26951): stdout: | (launched: 2022-12-13_13:36:26.359989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:28.223053 run osmo-stp_10.42.42.5(pid=26951): stderr: | 20221213133626546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133626546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133626547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133626547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133626547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133626548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133626548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:28.379527 run patchelf(pid=26954): Terminating (SIGINT) 13:36:28.560394 run patchelf(pid=26954): Terminated: ok {rc=0} 13:36:28.690936 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26951): Process ended prematurely: osmo-stp_10.42.42.5(pid=26951) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:36:28.700536 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:36:28.728526 run osmo-hlr_10.42.42.2(pid=26948): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26948)] 13:36:28.779175 run osmo-hlr_10.42.42.2(pid=26948): stdout: | (launched: 2022-12-13_13:36:25.359061) 13:36:28.830898 run osmo-hlr_10.42.42.2(pid=26948): stderr: | 20221213133625552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133625552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133625552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133625552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133625552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133625552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133625564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133625572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133625572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133625572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:28.882855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26947): Terminating (SIGTERM) 13:36:28.924923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Terminating (SIGTERM) 13:36:28.967142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Terminating (SIGTERM) 13:36:29.009891 --- ParallelTerminationStrategy: PID 26947 died... 13:36:29.030368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26947): Terminated: ok {rc=0} 13:36:29.076645 --- ParallelTerminationStrategy: PID 26950 died... 13:36:29.096514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Terminated: ok {rc=0} 13:36:29.142924 --- ParallelTerminationStrategy: PID 26953 died... 13:36:29.162824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Terminated: ok {rc=0} 13:36:29.250981 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:36:30.561632 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:30.569686 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:36:30.603107 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:36:30.638227 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:36:30.690563 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:36:30.724086 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:36:30.758679 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:36:31.349550 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:36:31.357442 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:31.373480 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:36:31.464477 tst switch_tch_pdch.py: using LAC 34300 13:36:31.630594 tst switch_tch_pdch.py: using RAC 130 13:36:31.761752 tst switch_tch_pdch.py: using CellId 34300 13:36:31.890170 tst switch_tch_pdch.py: using BVCI 34301 13:36:32.044371 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.056236 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.067681 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.079677 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.092093 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.104683 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.117436 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:36:32.130092 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:32.258898 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:32.377471 tst switch_tch_pdch.py:51: start network... 13:36:32.578424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:33.043178 run create_hlr_db(pid=26958): Launched 13:36:33.166477 bus /gobi_6: Setting Powered False 13:36:34.226543 run create_hlr_db(pid=26958): Terminated: ok {rc=0} 13:36:34.665694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Launched 13:36:34.988625 run osmo-hlr_10.42.42.2(pid=26961): Launched 13:36:35.114148 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:35.668263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Launched 13:36:35.989066 run osmo-stp_10.42.42.5(pid=26964): Launched 13:36:36.112553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:36.666033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Launched 13:36:36.789976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:37.060321 run patchelf(pid=26967): Launched 13:36:37.238949 run osmo-stp_10.42.42.5(pid=26964): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] 13:36:37.374080 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-13_13:36:35.930119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:37.511630 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221213133636118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133636118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133636118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133636118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133636119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133636119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133636119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:37.649710 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-13_13:36:35.930119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:37.780859 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221213133636118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133636118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133636118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133636118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133636119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133636119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133636119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:37.936029 run patchelf(pid=26967): Terminating (SIGINT) 13:36:38.115629 run patchelf(pid=26967): Terminated: ok {rc=0} 13:36:38.245853 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:36:38.255588 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 13:36:38.283189 run osmo-hlr_10.42.42.2(pid=26961): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26961)] 13:36:38.333290 run osmo-hlr_10.42.42.2(pid=26961): stdout: | (launched: 2022-12-13_13:36:34.929977) 13:36:38.384339 run osmo-hlr_10.42.42.2(pid=26961): stderr: | 20221213133635122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133635122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133635122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133635122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133635122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133635122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133635134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133635144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133635145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133635145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:38.436009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminating (SIGTERM) 13:36:38.477686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminating (SIGTERM) 13:36:38.519339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminating (SIGTERM) 13:36:38.561713 --- ParallelTerminationStrategy: PID 26960 died... 13:36:38.581756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminated: ok {rc=0} 13:36:38.627714 --- ParallelTerminationStrategy: PID 26963 died... 13:36:38.647438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminated: ok {rc=0} 13:36:38.693314 --- ParallelTerminationStrategy: PID 26966 died... 13:36:38.712876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminated: ok {rc=0} 13:36:38.802155 bus /gobi_0: Setting Powered False 13:36:39.899969 bus /gobi_0: Setting Powered False 13:36:41.015017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:36:42.268238 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:42.273939 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:36:42.307407 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:36:42.341950 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:36:42.398702 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:36:42.432516 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:36:42.466646 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:36:43.019138 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:36:43.024157 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.035185 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:36:43.103666 tst switch_tch_pdch.py: using LAC 34301 13:36:43.225401 tst switch_tch_pdch.py: using RAC 131 13:36:43.360518 tst switch_tch_pdch.py: using CellId 34301 13:36:43.486331 tst switch_tch_pdch.py: using BVCI 34302 13:36:43.603162 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.614749 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.626313 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.637888 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.649575 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.661252 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.672902 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:36:43.684604 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:36:43.802873 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:36:43.919230 tst switch_tch_pdch.py:51: start network... 13:36:44.119913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:44.558564 run create_hlr_db(pid=26971): Launched 13:36:44.684622 bus /gobi_6: Setting Powered False 13:36:45.744743 run create_hlr_db(pid=26971): Terminated: ok {rc=0} 13:36:46.193699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26973): Launched 13:36:46.507437 run osmo-hlr_10.42.42.2(pid=26974): Launched 13:36:46.746937 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:47.411632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26976): Launched 13:36:47.710056 run osmo-stp_10.42.42.5(pid=26977): Launched 13:36:47.822370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:48.311988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26979): Launched 13:36:48.426048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:48.678165 run patchelf(pid=26980): Launched 13:36:48.844761 run osmo-stp_10.42.42.5(pid=26977): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26977)] 13:36:48.971980 run osmo-stp_10.42.42.5(pid=26977): stdout: | (launched: 2022-12-13_13:36:47.654966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:49.100388 run osmo-stp_10.42.42.5(pid=26977): stderr: | 20221213133647822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133647822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133647822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133647823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133647823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133647823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133647823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:49.228589 run osmo-stp_10.42.42.5(pid=26977): stdout: | (launched: 2022-12-13_13:36:47.654966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:49.350591 run osmo-stp_10.42.42.5(pid=26977): stderr: | 20221213133647822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133647822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133647822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133647823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133647823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133647823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133647823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:49.495059 run patchelf(pid=26980): Terminating (SIGINT) 13:36:49.663571 run patchelf(pid=26980): Terminated: ok {rc=0} 13:36:49.784468 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26977): Process ended prematurely: osmo-stp_10.42.42.5(pid=26977) [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26977)] [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:36:49.793486 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:36:49.819748 run osmo-hlr_10.42.42.2(pid=26974): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26974)] 13:36:49.866552 run osmo-hlr_10.42.42.2(pid=26974): stdout: | (launched: 2022-12-13_13:36:46.450860) 13:36:49.914758 run osmo-hlr_10.42.42.2(pid=26974): stderr: | 20221213133646780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133646780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133646780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133646780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133646780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133646780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133646805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133646813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133646813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133646813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:49.964276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26973): Terminating (SIGTERM) 13:36:50.003633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26976): Terminating (SIGTERM) 13:36:50.042808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26979): Terminating (SIGTERM) 13:36:50.082301 --- ParallelTerminationStrategy: PID 26973 died... 13:36:50.101276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26973): Terminated: ok {rc=0} 13:36:50.144656 --- ParallelTerminationStrategy: PID 26976 died... 13:36:50.162985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26976): Terminated: ok {rc=0} 13:36:50.206259 --- ParallelTerminationStrategy: PID 26979 died... 13:36:50.224567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26979): Terminated: ok {rc=0} 13:36:50.307473 bus /gobi_0: Setting Powered False 13:36:51.401791 bus /gobi_0: Setting Powered False 13:36:52.512840 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:trx-umtrx --------------------------------------------------------------------- 13:36:53.764199 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:53.767908 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:36:53.799839 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:36:53.806663 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:36:53.859633 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:36:53.892902 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:36:53.900393 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:36:54.435391 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:36:54.440175 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:36:54.450809 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:36:54.498363 tst mo_mt_sms.py: using LAC 34302 13:36:54.617935 tst mo_mt_sms.py: using RAC 132 13:36:54.734441 tst mo_mt_sms.py: using CellId 34302 13:36:54.852590 tst mo_mt_sms.py: using BVCI 34303 13:36:54.961969 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:36:55.082418 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:36:55.201932 tst mo_mt_sms.py:9: start nitb and bts... 13:36:55.421817 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:36:56.077169 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26985): Launched 13:36:56.398696 run osmo-nitb_10.42.42.2(pid=26986): Launched 13:36:56.578066 run osmo-nitb_10.42.42.2(pid=26986): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26986)] 13:36:56.722425 run osmo-nitb_10.42.42.2(pid=26986): stdout: | (launched: 2022-12-13_13:36:56.340017) 13:36:56.868013 run osmo-nitb_10.42.42.2(pid=26986): stderr: | (launched: 2022-12-13_13:36:56.387824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:36:57.013827 run osmo-nitb_10.42.42.2(pid=26986): stdout: | (launched: 2022-12-13_13:36:56.340017) 13:36:57.153766 run osmo-nitb_10.42.42.2(pid=26986): stderr: | (launched: 2022-12-13_13:36:56.387824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26986) [trial-2390↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26986)] 13:36:57.521313 tst osmo-nitb_10.42.42.2(pid=26986): stdout: | (launched: 2022-12-13_13:36:56.340017) 13:36:57.650657 tst osmo-nitb_10.42.42.2(pid=26986): stderr: | (launched: 2022-12-13_13:36:56.387824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:36:57.803735 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26986) [trial-2390↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26986)] [trial-2390↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 13:36:57.812844 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:36:57.819919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26985): Terminating (SIGTERM) 13:36:58.031747 --- ParallelTerminationStrategy: PID 26985 died... 13:36:58.053939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26985): Terminated: ok {rc=0} 13:36:58.142894 bus /sierra_3: Setting Powered False 13:36:59.240805 bus /sierra_3: Setting Powered False 13:37:00.356507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:trx-umtrx --------------------------------------------------------------------- 13:37:01.587869 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:01.596940 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:37:01.655789 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:37:01.703596 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:37:01.765960 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:37:01.806516 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:37:01.834728 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:37:02.374740 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:37:02.380569 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.391791 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:37:02.440578 tst mo_mt_sms.py: using LAC 34303 13:37:02.566304 tst mo_mt_sms.py: using RAC 133 13:37:02.691200 tst mo_mt_sms.py: using CellId 34303 13:37:02.817338 tst mo_mt_sms.py: using BVCI 34304 13:37:02.933605 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.944820 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.955929 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.966908 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.978105 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:02.989329 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:37:03.110561 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:37:03.232023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:03.728577 run create_hlr_db(pid=26990): Launched 13:37:03.852342 bus /sierra_2: Setting Powered False 13:37:04.915978 run create_hlr_db(pid=26990): Terminated: ok {rc=0} 13:37:05.363366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26992): Launched 13:37:05.683923 run osmo-hlr_10.42.42.2(pid=26993): Launched 13:37:05.805252 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:06.354889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26995): Launched 13:37:06.677303 run osmo-stp_10.42.42.5(pid=26996): Launched 13:37:06.799545 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:07.381585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26998): Launched 13:37:07.704155 run osmo-msc_10.42.42.6(pid=26999): Launched 13:37:07.882940 run osmo-stp_10.42.42.5(pid=26996): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26996)] 13:37:08.017833 run osmo-stp_10.42.42.5(pid=26996): stdout: | (launched: 2022-12-13_13:37:06.618179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:08.155400 run osmo-stp_10.42.42.5(pid=26996): stderr: | 20221213133706806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133706806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133706806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133706807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133706807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133706807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133706807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:08.290101 run osmo-stp_10.42.42.5(pid=26996): stdout: | (launched: 2022-12-13_13:37:06.618179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:08.417406 run osmo-stp_10.42.42.5(pid=26996): stderr: | 20221213133706806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133706806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133706806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133706807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133706807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133706807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133706807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:08.570086 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26996): Process ended prematurely: osmo-stp_10.42.42.5(pid=26996) [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26996)] [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py:16] 13:37:08.579138 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 13:37:08.606271 run osmo-hlr_10.42.42.2(pid=26993): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26993)] 13:37:08.656792 run osmo-hlr_10.42.42.2(pid=26993): stdout: | (launched: 2022-12-13_13:37:05.625630) 13:37:08.708629 run osmo-hlr_10.42.42.2(pid=26993): stderr: | 20221213133705820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133705820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133705820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133705820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133705820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133705820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133705852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133705861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133705862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133705862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:08.781262 run osmo-msc_10.42.42.6(pid=26999): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26999)] 13:37:08.830949 run osmo-msc_10.42.42.6(pid=26999): stdout: | (launched: 2022-12-13_13:37:07.644837) 13:37:08.882474 run osmo-msc_10.42.42.6(pid=26999): stderr: | 20221213133707963 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133707963 DLGLOBAL DEBUG validating counter group 0x7fb3d8e9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133707963 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133707963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133707963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133707963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133707965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133707966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133707966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133707966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:08.934317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26992): Terminating (SIGTERM) 13:37:08.975974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26995): Terminating (SIGTERM) 13:37:09.017760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26998): Terminating (SIGTERM) 13:37:09.059710 --- ParallelTerminationStrategy: PID 26992 died... 13:37:09.079874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26992): Terminated: ok {rc=0} 13:37:09.126393 --- ParallelTerminationStrategy: PID 26995 died... 13:37:09.146269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26995): Terminated: ok {rc=0} 13:37:09.192097 --- ParallelTerminationStrategy: PID 26998 died... 13:37:09.212223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26998): Terminated: ok {rc=0} 13:37:09.299464 bus /sierra_3: Setting Powered False 13:37:10.397289 bus /sierra_3: Setting Powered False 13:37:11.512836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 13:37:12.739412 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:12.743069 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:37:12.775123 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:37:12.781835 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:37:12.821545 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:37:12.854425 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:37:12.861146 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:37:13.376462 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:37:13.381395 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:37:13.391967 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:37:13.439589 tst assert_extension.py: using LAC 34304 13:37:13.563105 tst assert_extension.py: using RAC 134 13:37:13.684743 tst assert_extension.py: using CellId 34304 13:37:13.803996 tst assert_extension.py: using BVCI 34305 13:37:13.921984 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:37:14.038196 tst assert_extension.py:10: start nitb and bts... 13:37:14.239034 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:37:14.852417 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27005): Launched 13:37:15.152776 run osmo-nitb_10.42.42.2(pid=27006): Launched 13:37:15.318365 run osmo-nitb_10.42.42.2(pid=27006): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27006)] 13:37:15.452614 run osmo-nitb_10.42.42.2(pid=27006): stdout: | (launched: 2022-12-13_13:37:15.097467) 13:37:15.588154 run osmo-nitb_10.42.42.2(pid=27006): stderr: | (launched: 2022-12-13_13:37:15.142273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:37:15.723766 run osmo-nitb_10.42.42.2(pid=27006): stdout: | (launched: 2022-12-13_13:37:15.097467) 13:37:15.857868 run osmo-nitb_10.42.42.2(pid=27006): stderr: | (launched: 2022-12-13_13:37:15.142273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27006): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27006) [trial-2390↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27006)] 13:37:16.265619 tst osmo-nitb_10.42.42.2(pid=27006): stdout: | (launched: 2022-12-13_13:37:15.097467) 13:37:16.431148 tst osmo-nitb_10.42.42.2(pid=27006): stderr: | (launched: 2022-12-13_13:37:15.142273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:37:16.607311 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27006): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27006) [trial-2390↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27006)] [trial-2390↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 13:37:16.617392 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:37:16.624784 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27005): Terminating (SIGTERM) 13:37:16.837560 --- ParallelTerminationStrategy: PID 27005 died... 13:37:16.862885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27005): Terminated: ok {rc=0} 13:37:16.954044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:trx-umtrx --------------------------------------------------------------------- 13:37:18.131937 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:18.137272 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:37:18.169824 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:37:18.196777 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:37:18.231484 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:37:18.264004 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:37:18.290654 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:37:18.819141 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:37:18.823971 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:18.834600 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:37:18.882696 tst assert_extension.py: using LAC 34305 13:37:19.013325 tst assert_extension.py: using RAC 135 13:37:19.138802 tst assert_extension.py: using CellId 34305 13:37:19.264425 tst assert_extension.py: using BVCI 34306 13:37:19.381176 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:19.392421 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:19.403902 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:19.415009 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:19.426456 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:37:19.437921 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:37:19.554776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:20.020310 run create_hlr_db(pid=27010): Launched 13:37:20.143290 bus /sierra_2: Setting Powered False 13:37:21.202658 run create_hlr_db(pid=27010): Terminated: ok {rc=0} 13:37:21.642281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Launched 13:37:21.965651 run osmo-hlr_10.42.42.2(pid=27013): Launched 13:37:22.087594 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:22.648885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Launched 13:37:22.968726 run osmo-stp_10.42.42.5(pid=27016): Launched 13:37:23.092365 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:23.672024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27018): Launched 13:37:23.993790 run osmo-msc_10.42.42.6(pid=27019): Launched 13:37:24.172525 run osmo-stp_10.42.42.5(pid=27016): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] 13:37:24.309192 run osmo-stp_10.42.42.5(pid=27016): stdout: | (launched: 2022-12-13_13:37:22.910084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:24.446393 run osmo-stp_10.42.42.5(pid=27016): stderr: | 20221213133723098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133723098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133723098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133723099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133723099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133723099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133723099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:24.580861 run osmo-stp_10.42.42.5(pid=27016): stdout: | (launched: 2022-12-13_13:37:22.910084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:24.708290 run osmo-stp_10.42.42.5(pid=27016): stderr: | 20221213133723098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133723098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133723098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133723099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133723099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133723099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133723099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:24.860922 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27016): Process ended prematurely: osmo-stp_10.42.42.5(pid=27016) [trial-2390↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] [trial-2390↪ussd:trx-umtrx↪assert_extension.py:17] 13:37:24.870002 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:37:24.896930 run osmo-hlr_10.42.42.2(pid=27013): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27013)] 13:37:24.947082 run osmo-hlr_10.42.42.2(pid=27013): stdout: | (launched: 2022-12-13_13:37:21.906587) 13:37:24.998477 run osmo-hlr_10.42.42.2(pid=27013): stderr: | 20221213133722100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133722100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133722100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133722100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133722100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133722101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133722113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133722122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133722122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133722122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:25.070306 run osmo-msc_10.42.42.6(pid=27019): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27019)] 13:37:25.119760 run osmo-msc_10.42.42.6(pid=27019): stdout: | (launched: 2022-12-13_13:37:23.934439) 13:37:25.171461 run osmo-msc_10.42.42.6(pid=27019): stderr: | 20221213133724253 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133724253 DLGLOBAL DEBUG validating counter group 0x7f5a8d228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133724253 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133724253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133724253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133724254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133724255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133724256 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133724256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133724256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:25.223630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Terminating (SIGTERM) 13:37:25.265366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Terminating (SIGTERM) 13:37:25.307339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27018): Terminating (SIGTERM) 13:37:25.350045 --- ParallelTerminationStrategy: PID 27012 died... 13:37:25.370283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Terminated: ok {rc=0} 13:37:25.416148 --- ParallelTerminationStrategy: PID 27015 died... 13:37:25.435652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Terminated: ok {rc=0} 13:37:25.481229 --- ParallelTerminationStrategy: PID 27018 died... 13:37:25.500678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27018): Terminated: ok {rc=0} 13:37:25.587040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:37:26.799140 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:26.806284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:37:26.839251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:37:26.865936 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:37:26.917583 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:37:26.951548 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:37:26.980136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:37:27.527904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:37:27.578170 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:27.589556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:37:27.659080 tst mo_mt_call.py: using LAC 34306 13:37:27.781323 tst mo_mt_call.py: using RAC 136 13:37:27.902946 tst mo_mt_call.py: using CellId 34306 13:37:28.033869 tst mo_mt_call.py: using BVCI 34307 13:37:28.155022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:28.166827 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:28.178503 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:28.190217 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:28.202587 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:28.214794 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:37:28.336229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:37:28.453147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:28.926184 run create_hlr_db(pid=27024): Launched 13:37:29.054073 bus /sierra_2: Setting Powered False 13:37:30.114614 run create_hlr_db(pid=27024): Terminated: ok {rc=0} 13:37:30.539766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27026): Launched 13:37:30.854710 run osmo-hlr_10.42.42.2(pid=27027): Launched 13:37:31.108369 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:31.873765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27029): Launched 13:37:32.191125 run osmo-stp_10.42.42.5(pid=27030): Launched 13:37:32.398443 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:33.001997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27032): Launched 13:37:33.331287 run osmo-msc_10.42.42.6(pid=27033): Launched 13:37:33.515428 run osmo-stp_10.42.42.5(pid=27030): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27030)] 13:37:33.654148 run osmo-stp_10.42.42.5(pid=27030): stdout: | (launched: 2022-12-13_13:37:32.129864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:33.793757 run osmo-stp_10.42.42.5(pid=27030): stderr: | 20221213133732408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133732408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133732408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133732409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133732409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133732409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133732409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:33.930820 run osmo-stp_10.42.42.5(pid=27030): stdout: | (launched: 2022-12-13_13:37:32.129864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:34.061339 run osmo-stp_10.42.42.5(pid=27030): stderr: | 20221213133732408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133732408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133732408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133732409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133732409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133732409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133732409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:34.217560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27030): Process ended prematurely: osmo-stp_10.42.42.5(pid=27030) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27030)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:37:34.227259 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 13:37:34.254965 run osmo-hlr_10.42.42.2(pid=27027): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27027)] 13:37:34.305575 run osmo-hlr_10.42.42.2(pid=27027): stdout: | (launched: 2022-12-13_13:37:30.789105) 13:37:34.357616 run osmo-hlr_10.42.42.2(pid=27027): stderr: | 20221213133731088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133731088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133731088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133731088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133731089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133731090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133731107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133731120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133731120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133731120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:34.430168 run osmo-msc_10.42.42.6(pid=27033): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27033)] 13:37:34.480289 run osmo-msc_10.42.42.6(pid=27033): stdout: | (launched: 2022-12-13_13:37:33.271546) 13:37:34.532575 run osmo-msc_10.42.42.6(pid=27033): stderr: | 20221213133733590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133733590 DLGLOBAL DEBUG validating counter group 0x7f407c2bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133733590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133733590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133733590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133733590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133733592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133733592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133733593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133733593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:34.584355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27026): Terminating (SIGTERM) 13:37:34.626544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27029): Terminating (SIGTERM) 13:37:34.668556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27032): Terminating (SIGTERM) 13:37:34.710827 --- ParallelTerminationStrategy: PID 27026 died... 13:37:34.731045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27026): Terminated: ok {rc=0} 13:37:34.777458 --- ParallelTerminationStrategy: PID 27029 died... 13:37:34.797274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27029): Terminated: ok {rc=0} 13:37:34.843599 --- ParallelTerminationStrategy: PID 27032 died... 13:37:34.863423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27032): Terminated: ok {rc=0} 13:37:34.951619 bus /sierra_3: Setting Powered False 13:37:36.050240 bus /sierra_3: Setting Powered False 13:37:37.168996 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:37:38.314497 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.326512 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:37:38.396705 tst mo_mt_call_osmux.py: using LAC 34307 13:37:38.517082 tst mo_mt_call_osmux.py: using RAC 137 13:37:38.638305 tst mo_mt_call_osmux.py: using CellId 34307 13:37:38.760145 tst mo_mt_call_osmux.py: using BVCI 34308 13:37:38.872620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.883768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.894728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.905664 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.916560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:37:38.927518 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:37:39.049510 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:37:39.168796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:39.643924 run create_hlr_db(pid=27035): Launched 13:37:39.769124 bus /sierra_2: Setting Powered False 13:37:40.830321 run create_hlr_db(pid=27035): Terminated: ok {rc=0} 13:37:41.255403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Launched 13:37:41.561881 run osmo-hlr_10.42.42.2(pid=27038): Launched 13:37:41.679890 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:42.219805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Launched 13:37:42.529770 run osmo-stp_10.42.42.5(pid=27041): Launched 13:37:42.650501 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:43.206509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27043): Launched 13:37:43.515192 run osmo-msc_10.42.42.6(pid=27044): Launched 13:37:43.686302 run osmo-stp_10.42.42.5(pid=27041): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] 13:37:43.815632 run osmo-stp_10.42.42.5(pid=27041): stdout: | (launched: 2022-12-13_13:37:42.469659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:43.945186 run osmo-stp_10.42.42.5(pid=27041): stderr: | 20221213133742642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133742642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133742642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133742643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133742643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133742644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133742644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:44.072472 run osmo-stp_10.42.42.5(pid=27041): stdout: | (launched: 2022-12-13_13:37:42.469659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:44.193510 run osmo-stp_10.42.42.5(pid=27041): stderr: | 20221213133742642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133742642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133742642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133742643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133742643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133742644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133742644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:44.338357 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27041): Process ended prematurely: osmo-stp_10.42.42.5(pid=27041) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:37:44.347363 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:37:44.373618 run osmo-hlr_10.42.42.2(pid=27038): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27038)] 13:37:44.421436 run osmo-hlr_10.42.42.2(pid=27038): stdout: | (launched: 2022-12-13_13:37:41.505588) 13:37:44.470319 run osmo-hlr_10.42.42.2(pid=27038): stderr: | 20221213133741679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133741679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133741679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133741679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133741679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133741679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133741691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133741699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133741699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133741699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:44.539924 run osmo-msc_10.42.42.6(pid=27044): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27044)] 13:37:44.587355 run osmo-msc_10.42.42.6(pid=27044): stdout: | (launched: 2022-12-13_13:37:43.458552) 13:37:44.636310 run osmo-msc_10.42.42.6(pid=27044): stderr: | 20221213133743730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133743730 DLGLOBAL DEBUG validating counter group 0x7f2aaba9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133743730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133743730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133743730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133743731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133743732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133743733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133743733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133743733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:44.685482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Terminating (SIGTERM) 13:37:44.724834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Terminating (SIGTERM) 13:37:44.764358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27043): Terminating (SIGTERM) 13:37:44.804117 --- ParallelTerminationStrategy: PID 27037 died... 13:37:44.823250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Terminated: ok {rc=0} 13:37:44.867039 --- ParallelTerminationStrategy: PID 27040 died... 13:37:44.885551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Terminated: ok {rc=0} 13:37:44.929129 --- ParallelTerminationStrategy: PID 27043 died... 13:37:44.947610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27043): Terminated: ok {rc=0} 13:37:45.031820 bus /sierra_3: Setting Powered False 13:37:46.137697 bus /sierra_3: Setting Powered False 13:37:47.272672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:37:48.521658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:48.528371 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:37:48.560709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:37:48.587197 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:37:48.639692 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:37:48.672373 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:37:48.699126 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:37:49.248345 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:37:49.297568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.308714 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:37:49.377563 tst mo_mt_call.py: using LAC 34308 13:37:49.497312 tst mo_mt_call.py: using RAC 138 13:37:49.617716 tst mo_mt_call.py: using CellId 34308 13:37:49.738616 tst mo_mt_call.py: using BVCI 34309 13:37:49.850537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.861665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.872567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.883487 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.894650 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:49.905818 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:37:50.022911 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:37:50.143772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:50.650456 run create_hlr_db(pid=27050): Launched 13:37:50.778432 bus /sierra_2: Setting Powered False 13:37:51.843269 run create_hlr_db(pid=27050): Terminated: ok {rc=0} 13:37:52.278105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Launched 13:37:52.584488 run osmo-hlr_10.42.42.2(pid=27053): Launched 13:37:52.702830 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:53.227031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Launched 13:37:53.533444 run osmo-stp_10.42.42.5(pid=27056): Launched 13:37:53.650673 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:54.206681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Launched 13:37:54.512105 run osmo-msc_10.42.42.6(pid=27059): Launched 13:37:54.682896 run osmo-stp_10.42.42.5(pid=27056): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] 13:37:54.814832 run osmo-stp_10.42.42.5(pid=27056): stdout: | (launched: 2022-12-13_13:37:53.477248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:54.944073 run osmo-stp_10.42.42.5(pid=27056): stderr: | 20221213133753645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133753645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133753645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133753646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133753646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133753646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133753646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:55.071551 run osmo-stp_10.42.42.5(pid=27056): stdout: | (launched: 2022-12-13_13:37:53.477248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:55.192605 run osmo-stp_10.42.42.5(pid=27056): stderr: | 20221213133753645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133753645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133753645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133753646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133753646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133753646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133753646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:55.337710 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27056): Process ended prematurely: osmo-stp_10.42.42.5(pid=27056) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:37:55.346739 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:37:55.373284 run osmo-hlr_10.42.42.2(pid=27053): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27053)] 13:37:55.421365 run osmo-hlr_10.42.42.2(pid=27053): stdout: | (launched: 2022-12-13_13:37:52.527942) 13:37:55.470616 run osmo-hlr_10.42.42.2(pid=27053): stderr: | 20221213133752703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133752703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133752703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133752703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133752703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133752703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133752715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133752723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133752723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133752723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:55.539334 run osmo-msc_10.42.42.6(pid=27059): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27059)] 13:37:55.586835 run osmo-msc_10.42.42.6(pid=27059): stdout: | (launched: 2022-12-13_13:37:54.455886) 13:37:55.635847 run osmo-msc_10.42.42.6(pid=27059): stderr: | 20221213133754726 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133754726 DLGLOBAL DEBUG validating counter group 0x7f035f373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133754726 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133754726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133754726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133754726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133754728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133754728 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133754730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133754730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:55.685112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Terminating (SIGTERM) 13:37:55.724768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Terminating (SIGTERM) 13:37:55.764328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Terminating (SIGTERM) 13:37:55.804145 --- ParallelTerminationStrategy: PID 27052 died... 13:37:55.823486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27052): Terminated: ok {rc=0} 13:37:55.867446 --- ParallelTerminationStrategy: PID 27055 died... 13:37:55.886205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27055): Terminated: ok {rc=0} 13:37:55.929897 --- ParallelTerminationStrategy: PID 27058 died... 13:37:55.948660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27058): Terminated: ok {rc=0} 13:37:56.032912 bus /sierra_3: Setting Powered False 13:37:57.131336 bus /sierra_3: Setting Powered False 13:37:58.247944 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:37:59.398488 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:37:59.410825 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:37:59.481987 tst mo_mt_call_osmux.py: using LAC 34309 13:37:59.613067 tst mo_mt_call_osmux.py: using RAC 139 13:37:59.742325 tst mo_mt_call_osmux.py: using CellId 34309 13:37:59.869316 tst mo_mt_call_osmux.py: using BVCI 34310 13:37:59.988460 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:00.000258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:00.011764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:00.023233 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:00.035108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:00.046904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:38:00.165588 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:38:00.292394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:00.800758 run create_hlr_db(pid=27061): Launched 13:38:00.955246 bus /sierra_2: Setting Powered False 13:38:02.015045 run create_hlr_db(pid=27061): Terminated: ok {rc=0} 13:38:02.505751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27063): Launched 13:38:02.841482 run osmo-hlr_10.42.42.2(pid=27064): Launched 13:38:02.968602 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:03.533998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27066): Launched 13:38:03.862028 run osmo-stp_10.42.42.5(pid=27067): Launched 13:38:03.986993 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:04.579085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27069): Launched 13:38:04.909077 run osmo-msc_10.42.42.6(pid=27070): Launched 13:38:05.093096 run osmo-stp_10.42.42.5(pid=27067): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27067)] 13:38:05.231380 run osmo-stp_10.42.42.5(pid=27067): stdout: | (launched: 2022-12-13_13:38:03.801749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:05.369950 run osmo-stp_10.42.42.5(pid=27067): stderr: | 20221213133803990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133803990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133803990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133803991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133803991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133803991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133803991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:05.507524 run osmo-stp_10.42.42.5(pid=27067): stdout: | (launched: 2022-12-13_13:38:03.801749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:05.637376 run osmo-stp_10.42.42.5(pid=27067): stderr: | 20221213133803990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133803990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133803990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133803991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133803991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133803991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133803991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:05.792764 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27067): Process ended prematurely: osmo-stp_10.42.42.5(pid=27067) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27067)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:38:05.802413 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:38:05.829853 run osmo-hlr_10.42.42.2(pid=27064): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27064)] 13:38:05.880056 run osmo-hlr_10.42.42.2(pid=27064): stdout: | (launched: 2022-12-13_13:38:02.781536) 13:38:05.931461 run osmo-hlr_10.42.42.2(pid=27064): stderr: | 20221213133802977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133802977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133802977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133802977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133802977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133802977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133802989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133802998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133802998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133802998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:06.003615 run osmo-msc_10.42.42.6(pid=27070): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27070)] 13:38:06.053206 run osmo-msc_10.42.42.6(pid=27070): stdout: | (launched: 2022-12-13_13:38:04.848931) 13:38:06.104677 run osmo-msc_10.42.42.6(pid=27070): stderr: | 20221213133805170 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133805170 DLGLOBAL DEBUG validating counter group 0x7f0d2dbc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133805170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133805170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133805170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133805171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133805172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133805173 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133805173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133805173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:06.156423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27063): Terminating (SIGTERM) 13:38:06.198502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27066): Terminating (SIGTERM) 13:38:06.240297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27069): Terminating (SIGTERM) 13:38:06.282427 --- ParallelTerminationStrategy: PID 27063 died... 13:38:06.302627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27063): Terminated: ok {rc=0} 13:38:06.348790 --- ParallelTerminationStrategy: PID 27066 died... 13:38:06.368621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27066): Terminated: ok {rc=0} 13:38:06.414452 --- ParallelTerminationStrategy: PID 27069 died... 13:38:06.434166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27069): Terminated: ok {rc=0} 13:38:06.522240 bus /sierra_3: Setting Powered False 13:38:07.620435 bus /sierra_3: Setting Powered False 13:38:08.734265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:38:09.986837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:09.995250 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:38:10.029231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:38:10.057461 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:38:10.109974 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:38:10.142794 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:38:10.170423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:38:10.722536 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:38:10.776600 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:10.788368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:38:10.857836 tst mo_mt_call.py: using LAC 34310 13:38:10.984857 tst mo_mt_call.py: using RAC 140 13:38:11.112325 tst mo_mt_call.py: using CellId 34310 13:38:11.240082 tst mo_mt_call.py: using BVCI 34311 13:38:11.360128 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:11.371655 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:11.383136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:11.394667 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:11.406511 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:11.418260 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:38:11.537882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:38:11.659911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:12.166938 run create_hlr_db(pid=27075): Launched 13:38:12.292361 bus /sierra_2: Setting Powered False 13:38:13.357183 run create_hlr_db(pid=27075): Terminated: ok {rc=0} 13:38:13.812320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27077): Launched 13:38:14.141345 run osmo-hlr_10.42.42.2(pid=27078): Launched 13:38:14.267541 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:14.836763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27080): Launched 13:38:15.165320 run osmo-stp_10.42.42.5(pid=27081): Launched 13:38:15.292568 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:15.893620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27083): Launched 13:38:16.245683 run osmo-msc_10.42.42.6(pid=27084): Launched 13:38:16.747272 run osmo-stp_10.42.42.5(pid=27081): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27081)] 13:38:17.100073 run osmo-stp_10.42.42.5(pid=27081): stdout: | (launched: 2022-12-13_13:38:15.105244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:17.246701 run osmo-stp_10.42.42.5(pid=27081): stderr: | 20221213133815297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133815297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133815297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133815298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133815298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133815298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133815298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:17.379427 run osmo-stp_10.42.42.5(pid=27081): stdout: | (launched: 2022-12-13_13:38:15.105244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:17.501173 run osmo-stp_10.42.42.5(pid=27081): stderr: | 20221213133815297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133815297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133815297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133815298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133815298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133815298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133815298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:17.647183 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27081): Process ended prematurely: osmo-stp_10.42.42.5(pid=27081) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27081)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:38:17.656504 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 13:38:17.683052 run osmo-hlr_10.42.42.2(pid=27078): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27078)] 13:38:17.730881 run osmo-hlr_10.42.42.2(pid=27078): stdout: | (launched: 2022-12-13_13:38:14.080784) 13:38:17.780143 run osmo-hlr_10.42.42.2(pid=27078): stderr: | 20221213133814276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133814276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133814276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133814276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133814276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133814276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133814288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133814297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133814297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133814297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:17.849166 run osmo-msc_10.42.42.6(pid=27084): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27084)] 13:38:17.896838 run osmo-msc_10.42.42.6(pid=27084): stdout: | (launched: 2022-12-13_13:38:16.186835) 13:38:17.946446 run osmo-msc_10.42.42.6(pid=27084): stderr: | 20221213133816596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133816598 DLGLOBAL DEBUG validating counter group 0x7faf1de5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133816598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133816598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133816599 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133816599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133816603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133816605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133816605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133816605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:17.995836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27077): Terminating (SIGTERM) 13:38:18.036202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27080): Terminating (SIGTERM) 13:38:18.079285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27083): Terminating (SIGTERM) 13:38:18.123050 --- ParallelTerminationStrategy: PID 27077 died... 13:38:18.142394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27077): Terminated: ok {rc=0} 13:38:18.187006 --- ParallelTerminationStrategy: PID 27080 died... 13:38:18.205853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27080): Terminated: ok {rc=0} 13:38:18.249779 --- ParallelTerminationStrategy: PID 27083 died... 13:38:18.268399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27083): Terminated: ok {rc=0} 13:38:18.353564 bus /sierra_3: Setting Powered False 13:38:19.453684 bus /sierra_3: Setting Powered False 13:38:20.568935 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:38:21.715867 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:21.727669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:38:21.797838 tst mo_mt_call_osmux.py: using LAC 34311 13:38:21.919638 tst mo_mt_call_osmux.py: using RAC 141 13:38:22.040711 tst mo_mt_call_osmux.py: using CellId 34311 13:38:22.160698 tst mo_mt_call_osmux.py: using BVCI 34312 13:38:22.271790 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:22.282976 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:22.293983 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:22.304879 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:22.316085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:38:22.327073 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:38:22.449545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:38:22.569119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:23.044456 run create_hlr_db(pid=27091): Launched 13:38:23.170085 bus /sierra_2: Setting Powered False 13:38:24.231165 run create_hlr_db(pid=27091): Terminated: ok {rc=0} 13:38:24.677856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Launched 13:38:25.005921 run osmo-hlr_10.42.42.2(pid=27094): Launched 13:38:25.131716 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:25.701311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Launched 13:38:26.029516 run osmo-stp_10.42.42.5(pid=27097): Launched 13:38:26.155191 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:26.750027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Launched 13:38:27.077848 run osmo-msc_10.42.42.6(pid=27100): Launched 13:38:27.262004 run osmo-stp_10.42.42.5(pid=27097): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] 13:38:27.400308 run osmo-stp_10.42.42.5(pid=27097): stdout: | (launched: 2022-12-13_13:38:25.968889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:27.540323 run osmo-stp_10.42.42.5(pid=27097): stderr: | 20221213133826159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133826159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133826159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133826159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133826160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133826160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133826160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:27.677528 run osmo-stp_10.42.42.5(pid=27097): stdout: | (launched: 2022-12-13_13:38:25.968889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:27.807530 run osmo-stp_10.42.42.5(pid=27097): stderr: | 20221213133826159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133826159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133826159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133826159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133826160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133826160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133826160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:27.963403 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27097): Process ended prematurely: osmo-stp_10.42.42.5(pid=27097) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:38:27.973524 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:38:28.001075 run osmo-hlr_10.42.42.2(pid=27094): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27094)] 13:38:28.051980 run osmo-hlr_10.42.42.2(pid=27094): stdout: | (launched: 2022-12-13_13:38:24.946059) 13:38:28.103786 run osmo-hlr_10.42.42.2(pid=27094): stderr: | 20221213133825141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133825141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133825141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133825142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133825142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133825142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133825153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133825162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133825162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133825163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:28.176327 run osmo-msc_10.42.42.6(pid=27100): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27100)] 13:38:28.226194 run osmo-msc_10.42.42.6(pid=27100): stdout: | (launched: 2022-12-13_13:38:27.017732) 13:38:28.277886 run osmo-msc_10.42.42.6(pid=27100): stderr: | 20221213133827338 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133827338 DLGLOBAL DEBUG validating counter group 0x7fe6d0112c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133827338 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133827338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133827338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133827338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133827340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133827340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133827341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133827341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:28.329908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Terminating (SIGTERM) 13:38:28.371757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Terminating (SIGTERM) 13:38:28.413677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Terminating (SIGTERM) 13:38:28.456633 --- ParallelTerminationStrategy: PID 27093 died... 13:38:28.476873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Terminated: ok {rc=0} 13:38:28.523449 --- ParallelTerminationStrategy: PID 27096 died... 13:38:28.543356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Terminated: ok {rc=0} 13:38:28.589756 --- ParallelTerminationStrategy: PID 27099 died... 13:38:28.609524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Terminated: ok {rc=0} 13:38:28.697843 bus /sierra_3: Setting Powered False 13:38:29.794144 bus /sierra_3: Setting Powered False 13:38:30.920941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:38:32.178853 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:32.187091 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:38:32.223048 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:38:32.252595 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:38:32.309271 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:38:32.343482 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:38:32.371578 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:38:32.922094 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:38:32.975466 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:32.987180 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:38:33.057612 tst mo_mt_call.py: using LAC 34312 13:38:33.186806 tst mo_mt_call.py: using RAC 142 13:38:33.314701 tst mo_mt_call.py: using CellId 34312 13:38:33.442542 tst mo_mt_call.py: using BVCI 34313 13:38:33.563439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:33.575023 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:33.586584 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:33.597963 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:33.609777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:33.621520 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:38:33.745475 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:38:33.867008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:34.341175 run create_hlr_db(pid=27105): Launched 13:38:34.468119 bus /sierra_2: Setting Powered False 13:38:35.528323 run create_hlr_db(pid=27105): Terminated: ok {rc=0} 13:38:35.974096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27107): Launched 13:38:36.304438 run osmo-hlr_10.42.42.2(pid=27108): Launched 13:38:36.428687 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:36.995572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27110): Launched 13:38:37.323568 run osmo-stp_10.42.42.5(pid=27111): Launched 13:38:37.448274 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:38.042568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27113): Launched 13:38:38.371619 run osmo-msc_10.42.42.6(pid=27114): Launched 13:38:38.555314 run osmo-stp_10.42.42.5(pid=27111): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27111)] 13:38:38.693853 run osmo-stp_10.42.42.5(pid=27111): stdout: | (launched: 2022-12-13_13:38:37.263541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:38.832293 run osmo-stp_10.42.42.5(pid=27111): stderr: | 20221213133837453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133837453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133837453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133837454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133837454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133837454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133837454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:38.969056 run osmo-stp_10.42.42.5(pid=27111): stdout: | (launched: 2022-12-13_13:38:37.263541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:39.098692 run osmo-stp_10.42.42.5(pid=27111): stderr: | 20221213133837453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133837453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133837453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133837454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133837454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133837454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133837454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:39.254784 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27111): Process ended prematurely: osmo-stp_10.42.42.5(pid=27111) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27111)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:38:39.264222 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:38:39.291939 run osmo-hlr_10.42.42.2(pid=27108): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27108)] 13:38:39.342626 run osmo-hlr_10.42.42.2(pid=27108): stdout: | (launched: 2022-12-13_13:38:36.244166) 13:38:39.394701 run osmo-hlr_10.42.42.2(pid=27108): stderr: | 20221213133836440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133836440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133836441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133836441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133836441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133836441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133836454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133836464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133836464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133836464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:39.467178 run osmo-msc_10.42.42.6(pid=27114): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27114)] 13:38:39.517125 run osmo-msc_10.42.42.6(pid=27114): stdout: | (launched: 2022-12-13_13:38:38.311514) 13:38:39.568870 run osmo-msc_10.42.42.6(pid=27114): stderr: | 20221213133838632 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133838632 DLGLOBAL DEBUG validating counter group 0x7f7039b17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133838633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133838633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133838633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133838633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133838635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133838635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133838635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133838635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:39.621317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27107): Terminating (SIGTERM) 13:38:39.663406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27110): Terminating (SIGTERM) 13:38:39.706024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27113): Terminating (SIGTERM) 13:38:39.748662 --- ParallelTerminationStrategy: PID 27107 died... 13:38:39.769486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27107): Terminated: ok {rc=0} 13:38:39.815935 --- ParallelTerminationStrategy: PID 27110 died... 13:38:39.835819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27110): Terminated: ok {rc=0} 13:38:39.882160 --- ParallelTerminationStrategy: PID 27113 died... 13:38:39.901971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27113): Terminated: ok {rc=0} 13:38:39.990312 bus /sierra_3: Setting Powered False 13:38:41.088795 bus /sierra_3: Setting Powered False 13:38:42.203122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:38:43.350001 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.361776 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:38:43.431078 tst mo_mt_call_osmux.py: using LAC 34313 13:38:43.552491 tst mo_mt_call_osmux.py: using RAC 143 13:38:43.673867 tst mo_mt_call_osmux.py: using CellId 34313 13:38:43.794960 tst mo_mt_call_osmux.py: using BVCI 34314 13:38:43.908425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.919610 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.930633 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.941548 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.952502 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:38:43.963438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:38:44.079363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:38:44.202335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:44.710462 run create_hlr_db(pid=27116): Launched 13:38:44.837718 bus /sierra_2: Setting Powered False 13:38:45.913619 run create_hlr_db(pid=27116): Terminated: ok {rc=0} 13:38:46.380732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Launched 13:38:46.727725 run osmo-hlr_10.42.42.2(pid=27119): Launched 13:38:46.992227 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:47.743281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Launched 13:38:48.154385 run osmo-stp_10.42.42.5(pid=27195): Launched 13:38:48.446452 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:49.299169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27346): Launched 13:38:49.694306 run osmo-msc_10.42.42.6(pid=27394): Launched 13:38:49.959492 run osmo-stp_10.42.42.5(pid=27195): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27195)] 13:38:50.182801 run osmo-stp_10.42.42.5(pid=27195): stdout: | (launched: 2022-12-13_13:38:48.084166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:50.462901 run osmo-stp_10.42.42.5(pid=27195): stderr: | 20221213133848460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133848460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133848481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133848482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133848482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133848482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133848482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:50.681546 run osmo-stp_10.42.42.5(pid=27195): stdout: | (launched: 2022-12-13_13:38:48.084166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:50.804929 run osmo-stp_10.42.42.5(pid=27195): stderr: | 20221213133848460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133848460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133848481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133848482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133848482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133848482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133848482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:50.954698 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27195): Process ended prematurely: osmo-stp_10.42.42.5(pid=27195) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27195)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:38:50.964882 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 13:38:50.992648 run osmo-hlr_10.42.42.2(pid=27119): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27119)] 13:38:51.042975 run osmo-hlr_10.42.42.2(pid=27119): stdout: | (launched: 2022-12-13_13:38:46.667659) 13:38:51.095725 run osmo-hlr_10.42.42.2(pid=27119): stderr: | 20221213133846981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133846981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133846981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133846981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133846981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133846981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133847001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133847020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133847020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133847020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:51.167049 run osmo-msc_10.42.42.6(pid=27394): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27394)] 13:38:51.216226 run osmo-msc_10.42.42.6(pid=27394): stdout: | (launched: 2022-12-13_13:38:49.624117) 13:38:51.268127 run osmo-msc_10.42.42.6(pid=27394): stderr: | 20221213133850197 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133850197 DLGLOBAL DEBUG validating counter group 0x7fa82a7a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133850198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133850198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133850198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133850198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133850200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133850200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133850200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133850200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:51.319580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Terminating (SIGTERM) 13:38:51.361459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminating (SIGTERM) 13:38:51.405208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27346): Terminating (SIGTERM) 13:38:51.449250 --- ParallelTerminationStrategy: PID 27118 died... 13:38:51.469446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Terminated: ok {rc=0} 13:38:51.516151 --- ParallelTerminationStrategy: PID 27168 died... 13:38:51.536040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminated: ok {rc=0} 13:38:51.586862 --- ParallelTerminationStrategy: PID 27346 died... 13:38:51.606167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27346): Terminated: ok {rc=0} 13:38:51.693303 bus /sierra_3: Setting Powered False 13:38:52.790202 bus /sierra_3: Setting Powered False 13:38:53.905499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:38:55.157412 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:55.165196 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:38:55.200475 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:38:55.230893 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:38:55.283155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:38:55.316779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:38:55.345578 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:38:55.896004 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:38:55.948617 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:55.960753 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:38:56.033551 tst mo_mt_call.py: using LAC 34314 13:38:56.159417 tst mo_mt_call.py: using RAC 144 13:38:56.287142 tst mo_mt_call.py: using CellId 34314 13:38:56.409245 tst mo_mt_call.py: using BVCI 34315 13:38:56.524467 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:56.536753 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:56.548716 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:56.560863 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:56.572884 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:38:56.585540 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:38:56.706875 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:38:56.828090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:57.313489 run create_hlr_db(pid=27401): Launched 13:38:57.468461 bus /sierra_2: Setting Powered False 13:38:58.530808 run create_hlr_db(pid=27401): Terminated: ok {rc=0} 13:38:58.967755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27403): Launched 13:38:59.295892 run osmo-hlr_10.42.42.2(pid=27404): Launched 13:38:59.528717 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:00.248791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27406): Launched 13:39:00.593359 run osmo-stp_10.42.42.5(pid=27407): Launched 13:39:00.839864 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:01.544813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27409): Launched 13:39:01.888739 run osmo-msc_10.42.42.6(pid=27410): Launched 13:39:02.258503 run osmo-stp_10.42.42.5(pid=27407): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27407)] 13:39:02.519147 run osmo-stp_10.42.42.5(pid=27407): stdout: | (launched: 2022-12-13_13:39:00.532632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:02.687519 run osmo-stp_10.42.42.5(pid=27407): stderr: | 20221213133900831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133900831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133900831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133900832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133900832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133900832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133900832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:02.828826 run osmo-stp_10.42.42.5(pid=27407): stdout: | (launched: 2022-12-13_13:39:00.532632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:02.963750 run osmo-stp_10.42.42.5(pid=27407): stderr: | 20221213133900831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133900831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133900831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133900832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133900832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133900832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133900832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:03.124886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27407): Process ended prematurely: osmo-stp_10.42.42.5(pid=27407) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27407)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:39:03.135914 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 13:39:03.165184 run osmo-hlr_10.42.42.2(pid=27404): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27404)] 13:39:03.220413 run osmo-hlr_10.42.42.2(pid=27404): stdout: | (launched: 2022-12-13_13:38:59.237780) 13:39:03.273599 run osmo-hlr_10.42.42.2(pid=27404): stderr: | 20221213133859576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133859576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133859576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133859576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133859576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133859576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133859595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133859607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133859608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133859608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:03.349410 run osmo-msc_10.42.42.6(pid=27410): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27410)] 13:39:03.402541 run osmo-msc_10.42.42.6(pid=27410): stdout: | (launched: 2022-12-13_13:39:01.827739) 13:39:03.456296 run osmo-msc_10.42.42.6(pid=27410): stderr: | 20221213133902334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133902334 DLGLOBAL DEBUG validating counter group 0x7f1800b8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133902334 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133902334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133902334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133902335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133902336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133902345 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133902345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133902345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:03.511089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27403): Terminating (SIGTERM) 13:39:03.555335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27406): Terminating (SIGTERM) 13:39:03.601922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27409): Terminating (SIGTERM) 13:39:03.648868 --- ParallelTerminationStrategy: PID 27403 died... 13:39:03.671146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27403): Terminated: ok {rc=0} 13:39:03.721311 --- ParallelTerminationStrategy: PID 27406 died... 13:39:03.743240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27406): Terminated: ok {rc=0} 13:39:03.792721 --- ParallelTerminationStrategy: PID 27409 died... 13:39:03.814670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27409): Terminated: ok {rc=0} 13:39:03.908388 bus /sierra_3: Setting Powered False 13:39:05.012230 bus /sierra_3: Setting Powered False 13:39:06.135906 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:39:07.294799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.308234 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:39:07.383107 tst mo_mt_call_osmux.py: using LAC 34315 13:39:07.518534 tst mo_mt_call_osmux.py: using RAC 145 13:39:07.654333 tst mo_mt_call_osmux.py: using CellId 34315 13:39:07.786381 tst mo_mt_call_osmux.py: using BVCI 34316 13:39:07.910640 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.923290 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.935978 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.948906 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.962855 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:39:07.976387 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:39:08.105367 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:39:08.237394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:08.764692 run create_hlr_db(pid=27412): Launched 13:39:08.932301 bus /sierra_2: Setting Powered False 13:39:10.000224 run create_hlr_db(pid=27412): Terminated: ok {rc=0} 13:39:10.476613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27414): Launched 13:39:10.824895 run osmo-hlr_10.42.42.2(pid=27415): Launched 13:39:11.078497 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:11.768514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27417): Launched 13:39:12.111321 run osmo-stp_10.42.42.5(pid=27419): Launched 13:39:12.239417 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:12.831654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27421): Launched 13:39:13.162391 run osmo-msc_10.42.42.6(pid=27422): Launched 13:39:13.347279 run osmo-stp_10.42.42.5(pid=27419): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] 13:39:13.485359 run osmo-stp_10.42.42.5(pid=27419): stdout: | (launched: 2022-12-13_13:39:12.051341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:13.624250 run osmo-stp_10.42.42.5(pid=27419): stderr: | 20221213133912239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133912240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133912240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133912240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133912241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133912241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133912241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:13.761259 run osmo-stp_10.42.42.5(pid=27419): stdout: | (launched: 2022-12-13_13:39:12.051341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:13.891475 run osmo-stp_10.42.42.5(pid=27419): stderr: | 20221213133912239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133912240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133912240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133912240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133912241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133912241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133912241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:14.047322 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27419): Process ended prematurely: osmo-stp_10.42.42.5(pid=27419) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:39:14.057204 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 13:39:14.085106 run osmo-hlr_10.42.42.2(pid=27415): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27415)] 13:39:14.135994 run osmo-hlr_10.42.42.2(pid=27415): stdout: | (launched: 2022-12-13_13:39:10.764619) 13:39:14.187997 run osmo-hlr_10.42.42.2(pid=27415): stderr: | 20221213133911082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133911082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133911082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133911082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133911082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133911082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133911094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133911107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133911107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133911107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:14.261498 run osmo-msc_10.42.42.6(pid=27422): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27422)] 13:39:14.311501 run osmo-msc_10.42.42.6(pid=27422): stdout: | (launched: 2022-12-13_13:39:13.102146) 13:39:14.363474 run osmo-msc_10.42.42.6(pid=27422): stderr: | 20221213133913421 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133913422 DLGLOBAL DEBUG validating counter group 0x7f6e118fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133913422 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133913422 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133913422 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133913422 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133913424 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133913424 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133913424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133913424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:14.415490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27414): Terminating (SIGTERM) 13:39:14.457621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27417): Terminating (SIGTERM) 13:39:14.499651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27421): Terminating (SIGTERM) 13:39:14.542618 --- ParallelTerminationStrategy: PID 27414 died... 13:39:14.563502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27414): Terminated: ok {rc=0} 13:39:14.610045 --- ParallelTerminationStrategy: PID 27417 died... 13:39:14.630054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27417): Terminated: ok {rc=0} 13:39:14.676384 --- ParallelTerminationStrategy: PID 27421 died... 13:39:14.696401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27421): Terminated: ok {rc=0} 13:39:14.783807 bus /sierra_3: Setting Powered False 13:39:15.896096 bus /sierra_3: Setting Powered False 13:39:17.034349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:39:18.295955 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:18.303496 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:39:18.337958 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:39:18.365600 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:39:18.423094 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:39:18.456028 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:39:18.483173 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:39:19.029392 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:39:19.079419 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.090721 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:39:19.162065 tst mo_mt_call.py: using LAC 34316 13:39:19.281353 tst mo_mt_call.py: using RAC 146 13:39:19.401306 tst mo_mt_call.py: using CellId 34316 13:39:19.522004 tst mo_mt_call.py: using BVCI 34317 13:39:19.633612 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.644642 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.655772 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.666771 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.678444 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:19.690051 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:39:19.812199 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:39:19.930528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:20.406333 run create_hlr_db(pid=27428): Launched 13:39:20.533233 bus /sierra_2: Setting Powered False 13:39:21.593701 run create_hlr_db(pid=27428): Terminated: ok {rc=0} 13:39:22.039939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Launched 13:39:22.371151 run osmo-hlr_10.42.42.2(pid=27431): Launched 13:39:22.495337 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:23.063036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Launched 13:39:23.392447 run osmo-stp_10.42.42.5(pid=27434): Launched 13:39:23.516826 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:24.106629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Launched 13:39:24.434359 run osmo-msc_10.42.42.6(pid=27437): Launched 13:39:24.620634 run osmo-stp_10.42.42.5(pid=27434): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] 13:39:24.760643 run osmo-stp_10.42.42.5(pid=27434): stdout: | (launched: 2022-12-13_13:39:23.332512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:24.901272 run osmo-stp_10.42.42.5(pid=27434): stderr: | 20221213133923523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133923523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133923523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133923524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133923524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133923524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133923524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:25.040798 run osmo-stp_10.42.42.5(pid=27434): stdout: | (launched: 2022-12-13_13:39:23.332512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:25.163961 run osmo-stp_10.42.42.5(pid=27434): stderr: | 20221213133923523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133923523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133923523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133923524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133923524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133923524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133923524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:25.309930 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27434): Process ended prematurely: osmo-stp_10.42.42.5(pid=27434) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:39:25.318925 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:39:25.345210 run osmo-hlr_10.42.42.2(pid=27431): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27431)] 13:39:25.392150 run osmo-hlr_10.42.42.2(pid=27431): stdout: | (launched: 2022-12-13_13:39:22.310756) 13:39:25.440777 run osmo-hlr_10.42.42.2(pid=27431): stderr: | 20221213133922506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133922506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133922506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133922506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133922506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133922506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133922520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133922528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133922529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133922529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:25.508458 run osmo-msc_10.42.42.6(pid=27437): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27437)] 13:39:25.555098 run osmo-msc_10.42.42.6(pid=27437): stdout: | (launched: 2022-12-13_13:39:24.374310) 13:39:25.603335 run osmo-msc_10.42.42.6(pid=27437): stderr: | 20221213133924690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133924690 DLGLOBAL DEBUG validating counter group 0x7fd20a090c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133924690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133924691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133924691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133924691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133924693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133924694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133924694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133924694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:25.652025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Terminating (SIGTERM) 13:39:25.691096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Terminating (SIGTERM) 13:39:25.729973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Terminating (SIGTERM) 13:39:25.769208 --- ParallelTerminationStrategy: PID 27430 died... 13:39:25.788312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Terminated: ok {rc=0} 13:39:25.831843 --- ParallelTerminationStrategy: PID 27433 died... 13:39:25.850300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Terminated: ok {rc=0} 13:39:25.893544 --- ParallelTerminationStrategy: PID 27436 died... 13:39:25.912524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Terminated: ok {rc=0} 13:39:25.998808 bus /sierra_3: Setting Powered False 13:39:27.095991 bus /sierra_3: Setting Powered False 13:39:28.209788 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:39:29.354621 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.366562 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:39:29.435864 tst mo_mt_call_osmux.py: using LAC 34317 13:39:29.558331 tst mo_mt_call_osmux.py: using RAC 147 13:39:29.685029 tst mo_mt_call_osmux.py: using CellId 34317 13:39:29.804284 tst mo_mt_call_osmux.py: using BVCI 34318 13:39:29.914870 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.926228 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.937284 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.948297 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.959441 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:39:29.970590 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:39:30.093054 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:39:30.211678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:30.686085 run create_hlr_db(pid=27439): Launched 13:39:30.812683 bus /sierra_2: Setting Powered False 13:39:31.879354 run create_hlr_db(pid=27439): Terminated: ok {rc=0} 13:39:32.349157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27441): Launched 13:39:32.677540 run osmo-hlr_10.42.42.2(pid=27442): Launched 13:39:32.805132 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:33.377563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27444): Launched 13:39:33.706720 run osmo-stp_10.42.42.5(pid=27445): Launched 13:39:33.831795 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:34.423360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27447): Launched 13:39:34.751569 run osmo-msc_10.42.42.6(pid=27448): Launched 13:39:34.935658 run osmo-stp_10.42.42.5(pid=27445): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27445)] 13:39:35.074415 run osmo-stp_10.42.42.5(pid=27445): stdout: | (launched: 2022-12-13_13:39:33.646588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:35.213743 run osmo-stp_10.42.42.5(pid=27445): stderr: | 20221213133933836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133933836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133933836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133933837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133933837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133933837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133933837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:35.351128 run osmo-stp_10.42.42.5(pid=27445): stdout: | (launched: 2022-12-13_13:39:33.646588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:35.481351 run osmo-stp_10.42.42.5(pid=27445): stderr: | 20221213133933836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133933836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133933836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133933837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133933837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133933837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133933837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:35.637228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27445): Process ended prematurely: osmo-stp_10.42.42.5(pid=27445) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27445)] [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:39:35.647171 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:39:35.674912 run osmo-hlr_10.42.42.2(pid=27442): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27442)] 13:39:35.725362 run osmo-hlr_10.42.42.2(pid=27442): stdout: | (launched: 2022-12-13_13:39:32.617615) 13:39:35.777503 run osmo-hlr_10.42.42.2(pid=27442): stderr: | 20221213133932811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133932811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133932811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133932812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133932812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133932812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133932824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133932832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133932833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133932834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:35.849703 run osmo-msc_10.42.42.6(pid=27448): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27448)] 13:39:35.899236 run osmo-msc_10.42.42.6(pid=27448): stdout: | (launched: 2022-12-13_13:39:34.691578) 13:39:35.950790 run osmo-msc_10.42.42.6(pid=27448): stderr: | 20221213133935009 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133935009 DLGLOBAL DEBUG validating counter group 0x7f2261bdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133935009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133935009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133935009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133935010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133935011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133935012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133935012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133935012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:36.002680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27441): Terminating (SIGTERM) 13:39:36.044554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27444): Terminating (SIGTERM) 13:39:36.087115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27447): Terminating (SIGTERM) 13:39:36.129464 --- ParallelTerminationStrategy: PID 27441 died... 13:39:36.149886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27441): Terminated: ok {rc=0} 13:39:36.196301 --- ParallelTerminationStrategy: PID 27444 died... 13:39:36.216561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27444): Terminated: ok {rc=0} 13:39:36.262576 --- ParallelTerminationStrategy: PID 27447 died... 13:39:36.282265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27447): Terminated: ok {rc=0} 13:39:36.369372 bus /sierra_3: Setting Powered False 13:39:37.467479 bus /sierra_3: Setting Powered False 13:39:38.585715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:39:39.834613 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:39.840108 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:39:39.872598 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:39:39.899403 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:39:39.950772 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:39:39.983055 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:39:40.009719 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:39:40.559166 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:39:40.608088 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:40.619272 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:39:40.688604 tst mo_mt_call.py: using LAC 34318 13:39:40.808555 tst mo_mt_call.py: using RAC 148 13:39:40.929086 tst mo_mt_call.py: using CellId 34318 13:39:41.048817 tst mo_mt_call.py: using BVCI 34319 13:39:41.160840 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:41.171714 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:41.182431 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:41.193143 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:41.203769 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:41.215210 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:39:41.332371 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:39:41.449441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:41.924877 run create_hlr_db(pid=27454): Launched 13:39:42.051764 bus /sierra_2: Setting Powered False 13:39:43.111698 run create_hlr_db(pid=27454): Terminated: ok {rc=0} 13:39:43.559788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27456): Launched 13:39:43.888770 run osmo-hlr_10.42.42.2(pid=27457): Launched 13:39:44.012870 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:44.578623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27459): Launched 13:39:44.906668 run osmo-stp_10.42.42.5(pid=27460): Launched 13:39:45.031574 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:45.622686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27462): Launched 13:39:45.985738 run osmo-msc_10.42.42.6(pid=27463): Launched 13:39:46.196919 run osmo-stp_10.42.42.5(pid=27460): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27460)] 13:39:46.463225 run osmo-stp_10.42.42.5(pid=27460): stdout: | (launched: 2022-12-13_13:39:44.847045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:46.733230 run osmo-stp_10.42.42.5(pid=27460): stderr: | 20221213133945034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133945035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133945035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133945035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133945036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133945036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133945036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:46.966158 run osmo-stp_10.42.42.5(pid=27460): stdout: | (launched: 2022-12-13_13:39:44.847045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:47.145341 run osmo-stp_10.42.42.5(pid=27460): stderr: | 20221213133945034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133945035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133945035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133945035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133945036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133945036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133945036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:47.301895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27460): Process ended prematurely: osmo-stp_10.42.42.5(pid=27460) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27460)] [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:39:47.310995 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 13:39:47.337472 run osmo-hlr_10.42.42.2(pid=27457): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27457)] 13:39:47.385646 run osmo-hlr_10.42.42.2(pid=27457): stdout: | (launched: 2022-12-13_13:39:43.829065) 13:39:47.435279 run osmo-hlr_10.42.42.2(pid=27457): stderr: | 20221213133944023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133944023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133944023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133944023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133944023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133944023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133944036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133944045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133944045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133944045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:47.504625 run osmo-msc_10.42.42.6(pid=27463): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27463)] 13:39:47.552333 run osmo-msc_10.42.42.6(pid=27463): stdout: | (launched: 2022-12-13_13:39:45.919535) 13:39:47.601467 run osmo-msc_10.42.42.6(pid=27463): stderr: | 20221213133946507 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133946507 DLGLOBAL DEBUG validating counter group 0x7f1029273c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133946507 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133946507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133946507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133946508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133946518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133946518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133946518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133946518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:47.650991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27456): Terminating (SIGTERM) 13:39:47.690463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27459): Terminating (SIGTERM) 13:39:47.730108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27462): Terminating (SIGTERM) 13:39:47.770514 --- ParallelTerminationStrategy: PID 27456 died... 13:39:47.789368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27456): Terminated: ok {rc=0} 13:39:47.833277 --- ParallelTerminationStrategy: PID 27459 died... 13:39:47.851651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27459): Terminated: ok {rc=0} 13:39:47.895494 --- ParallelTerminationStrategy: PID 27462 died... 13:39:47.914343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27462): Terminated: ok {rc=0} 13:39:48.000022 bus /sierra_3: Setting Powered False 13:39:49.099635 bus /sierra_3: Setting Powered False 13:39:50.215418 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:39:51.365568 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:51.377753 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:39:51.450325 tst mo_mt_call_osmux.py: using LAC 34319 13:39:51.580396 tst mo_mt_call_osmux.py: using RAC 149 13:39:51.710357 tst mo_mt_call_osmux.py: using CellId 34319 13:39:51.840122 tst mo_mt_call_osmux.py: using BVCI 34320 13:39:51.961643 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:51.973159 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:51.984422 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:51.995764 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:52.007346 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:39:52.019405 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:39:52.138550 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:39:52.260681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:52.770127 run create_hlr_db(pid=27465): Launched 13:39:52.895291 bus /sierra_2: Setting Powered False 13:39:53.959186 run create_hlr_db(pid=27465): Terminated: ok {rc=0} 13:39:54.396741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Launched 13:39:54.723227 run osmo-hlr_10.42.42.2(pid=27468): Launched 13:39:54.848833 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:55.414796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Launched 13:39:55.743000 run osmo-stp_10.42.42.5(pid=27471): Launched 13:39:55.868325 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:56.465540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27473): Launched 13:39:56.795655 run osmo-msc_10.42.42.6(pid=27474): Launched 13:39:56.979758 run osmo-stp_10.42.42.5(pid=27471): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] 13:39:57.117833 run osmo-stp_10.42.42.5(pid=27471): stdout: | (launched: 2022-12-13_13:39:55.683119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:57.256762 run osmo-stp_10.42.42.5(pid=27471): stderr: | 20221213133955872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133955872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133955873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133955873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133955874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133955874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133955874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:57.393542 run osmo-stp_10.42.42.5(pid=27471): stdout: | (launched: 2022-12-13_13:39:55.683119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:57.523542 run osmo-stp_10.42.42.5(pid=27471): stderr: | 20221213133955872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213133955872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213133955873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213133955873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213133955874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213133955874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213133955874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:57.679389 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27471): Process ended prematurely: osmo-stp_10.42.42.5(pid=27471) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:39:57.688921 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:39:57.717087 run osmo-hlr_10.42.42.2(pid=27468): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27468)] 13:39:57.767869 run osmo-hlr_10.42.42.2(pid=27468): stdout: | (launched: 2022-12-13_13:39:54.663541) 13:39:57.820171 run osmo-hlr_10.42.42.2(pid=27468): stderr: | 20221213133954858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213133954858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213133954858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213133954858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213133954858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213133954858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213133954870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213133954879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213133954879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213133954879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:57.892632 run osmo-msc_10.42.42.6(pid=27474): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27474)] 13:39:57.942689 run osmo-msc_10.42.42.6(pid=27474): stdout: | (launched: 2022-12-13_13:39:56.735274) 13:39:57.994601 run osmo-msc_10.42.42.6(pid=27474): stderr: | 20221213133957054 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213133957054 DLGLOBAL DEBUG validating counter group 0x7f897e791c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213133957054 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213133957054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213133957055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213133957055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213133957056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213133957057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213133957057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213133957057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:58.046908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Terminating (SIGTERM) 13:39:58.089034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Terminating (SIGTERM) 13:39:58.131544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27473): Terminating (SIGTERM) 13:39:58.174263 --- ParallelTerminationStrategy: PID 27467 died... 13:39:58.194636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Terminated: ok {rc=0} 13:39:58.241574 --- ParallelTerminationStrategy: PID 27470 died... 13:39:58.261438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Terminated: ok {rc=0} 13:39:58.308048 --- ParallelTerminationStrategy: PID 27473 died... 13:39:58.328132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27473): Terminated: ok {rc=0} 13:39:58.416616 bus /sierra_3: Setting Powered False 13:39:59.513920 bus /sierra_3: Setting Powered False 13:40:00.625855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:40:01.878272 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:01.885702 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:40:01.919341 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:40:01.947096 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:40:01.998869 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:40:02.049720 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:40:02.085151 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:40:02.615687 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:40:02.669567 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:02.681655 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:40:02.738466 tst mo_mt_call.py: using LAC 34320 13:40:02.859806 tst mo_mt_call.py: using RAC 150 13:40:02.982761 tst mo_mt_call.py: using CellId 34320 13:40:03.104689 tst mo_mt_call.py: using BVCI 34321 13:40:03.218296 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:03.229769 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:03.241128 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:03.252306 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:03.263550 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:03.274733 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:40:03.397169 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:40:03.519565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:04.027183 run create_hlr_db(pid=27482): Launched 13:40:04.152709 bus /sierra_2: Setting Powered False 13:40:05.217739 run create_hlr_db(pid=27482): Terminated: ok {rc=0} 13:40:05.654377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27484): Launched 13:40:05.960049 run osmo-hlr_10.42.42.2(pid=27485): Launched 13:40:06.075774 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:06.615696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27487): Launched 13:40:06.922024 run osmo-stp_10.42.42.5(pid=27488): Launched 13:40:07.039896 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:07.592350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27490): Launched 13:40:07.900514 run osmo-msc_10.42.42.6(pid=27491): Launched 13:40:08.071438 run osmo-stp_10.42.42.5(pid=27488): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27488)] 13:40:08.200136 run osmo-stp_10.42.42.5(pid=27488): stdout: | (launched: 2022-12-13_13:40:06.865433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:08.329384 run osmo-stp_10.42.42.5(pid=27488): stderr: | 20221213134007032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134007033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134007033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134007033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134007034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134007034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134007034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:08.456469 run osmo-stp_10.42.42.5(pid=27488): stdout: | (launched: 2022-12-13_13:40:06.865433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:08.578086 run osmo-stp_10.42.42.5(pid=27488): stderr: | 20221213134007032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134007033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134007033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134007033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134007034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134007034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134007034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:08.723042 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27488): Process ended prematurely: osmo-stp_10.42.42.5(pid=27488) [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27488)] [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:40:08.732131 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:40:08.758369 run osmo-hlr_10.42.42.2(pid=27485): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27485)] 13:40:08.805239 run osmo-hlr_10.42.42.2(pid=27485): stdout: | (launched: 2022-12-13_13:40:05.903787) 13:40:08.853954 run osmo-hlr_10.42.42.2(pid=27485): stderr: | 20221213134006078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134006078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134006078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134006078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134006078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134006078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134006090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134006098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134006098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134006098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:08.921639 run osmo-msc_10.42.42.6(pid=27491): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27491)] 13:40:08.969187 run osmo-msc_10.42.42.6(pid=27491): stdout: | (launched: 2022-12-13_13:40:07.843476) 13:40:09.017758 run osmo-msc_10.42.42.6(pid=27491): stderr: | 20221213134008113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134008113 DLGLOBAL DEBUG validating counter group 0x7f2fe7b5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134008113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134008113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134008114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134008114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134008116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134008116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134008117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134008117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:09.066548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27484): Terminating (SIGTERM) 13:40:09.105684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27487): Terminating (SIGTERM) 13:40:09.145149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27490): Terminating (SIGTERM) 13:40:09.184847 --- ParallelTerminationStrategy: PID 27484 died... 13:40:09.203947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27484): Terminated: ok {rc=0} 13:40:09.247577 --- ParallelTerminationStrategy: PID 27487 died... 13:40:09.266156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27487): Terminated: ok {rc=0} 13:40:09.309101 --- ParallelTerminationStrategy: PID 27490 died... 13:40:09.327470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27490): Terminated: ok {rc=0} 13:40:09.409560 bus /sierra_3: Setting Powered False 13:40:10.505541 bus /sierra_3: Setting Powered False 13:40:11.620507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:40:12.766218 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:12.778272 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:40:12.830263 tst mo_mt_call_osmux.py: using LAC 34321 13:40:12.952510 tst mo_mt_call_osmux.py: using RAC 151 13:40:13.074880 tst mo_mt_call_osmux.py: using CellId 34321 13:40:13.195972 tst mo_mt_call_osmux.py: using BVCI 34322 13:40:13.308495 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:13.319996 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:13.331122 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:13.342276 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:13.353538 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:40:13.364685 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:40:13.487102 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:40:13.610502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:14.118873 run create_hlr_db(pid=27493): Launched 13:40:14.247223 bus /sierra_2: Setting Powered False 13:40:15.311621 run create_hlr_db(pid=27493): Terminated: ok {rc=0} 13:40:15.748242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27495): Launched 13:40:16.094059 run osmo-hlr_10.42.42.2(pid=27496): Launched 13:40:16.241602 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:16.963704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27498): Launched 13:40:17.351552 run osmo-stp_10.42.42.5(pid=27499): Launched 13:40:17.493284 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:18.088434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27501): Launched 13:40:18.396798 run osmo-msc_10.42.42.6(pid=27502): Launched 13:40:18.569285 run osmo-stp_10.42.42.5(pid=27499): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27499)] 13:40:18.699464 run osmo-stp_10.42.42.5(pid=27499): stdout: | (launched: 2022-12-13_13:40:17.293786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:18.828885 run osmo-stp_10.42.42.5(pid=27499): stderr: | 20221213134017619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134017619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134017620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134017620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134017621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134017621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134017621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:18.955893 run osmo-stp_10.42.42.5(pid=27499): stdout: | (launched: 2022-12-13_13:40:17.293786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:19.076635 run osmo-stp_10.42.42.5(pid=27499): stderr: | 20221213134017619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134017619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134017620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134017620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134017621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134017621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134017621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:19.221891 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27499): Process ended prematurely: osmo-stp_10.42.42.5(pid=27499) [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27499)] [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:40:19.230811 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:40:19.256928 run osmo-hlr_10.42.42.2(pid=27496): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27496)] 13:40:19.304084 run osmo-hlr_10.42.42.2(pid=27496): stdout: | (launched: 2022-12-13_13:40:16.031088) 13:40:19.352752 run osmo-hlr_10.42.42.2(pid=27496): stderr: | 20221213134016374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134016374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134016374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134016374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134016374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134016374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134016387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134016402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134016403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134016403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:19.420593 run osmo-msc_10.42.42.6(pid=27502): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27502)] 13:40:19.467508 run osmo-msc_10.42.42.6(pid=27502): stdout: | (launched: 2022-12-13_13:40:18.339562) 13:40:19.516047 run osmo-msc_10.42.42.6(pid=27502): stderr: | 20221213134018610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134018610 DLGLOBAL DEBUG validating counter group 0x7f42ca67dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134018610 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134018610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134018610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134018610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134018612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134018612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134018613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134018613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:19.565191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27495): Terminating (SIGTERM) 13:40:19.604003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27498): Terminating (SIGTERM) 13:40:19.643183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27501): Terminating (SIGTERM) 13:40:19.682706 --- ParallelTerminationStrategy: PID 27495 died... 13:40:19.701493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27495): Terminated: ok {rc=0} 13:40:19.744635 --- ParallelTerminationStrategy: PID 27498 died... 13:40:19.763086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27498): Terminated: ok {rc=0} 13:40:19.806179 --- ParallelTerminationStrategy: PID 27501 died... 13:40:19.824583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27501): Terminated: ok {rc=0} 13:40:19.907547 bus /sierra_3: Setting Powered False 13:40:21.004808 bus /sierra_3: Setting Powered False 13:40:22.121710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:trx-umtrx --------------------------------------------------------------------- 13:40:23.373231 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:23.378223 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:40:23.411663 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:40:23.440156 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:40:23.526811 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:40:23.560213 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:40:23.587949 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:40:24.173809 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 13:40:24.179261 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.190487 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:40:24.239998 tst emergency_mo_mt_call.py: using LAC 34322 13:40:24.358316 tst emergency_mo_mt_call.py: using RAC 152 13:40:24.478133 tst emergency_mo_mt_call.py: using CellId 34322 13:40:24.594825 tst emergency_mo_mt_call.py: using BVCI 34323 13:40:24.705140 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.715877 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.726500 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.737224 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.747798 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:24.758416 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:24.876327 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:24.998221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:25.498114 run create_hlr_db(pid=27507): Launched 13:40:25.622610 bus /sierra_2: Setting Powered False 13:40:26.686106 run create_hlr_db(pid=27507): Terminated: ok {rc=0} 13:40:27.134834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27509): Launched 13:40:27.456775 run osmo-hlr_10.42.42.2(pid=27510): Launched 13:40:27.580938 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:28.132906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27512): Launched 13:40:28.456250 run osmo-stp_10.42.42.5(pid=27513): Launched 13:40:28.592097 tst emergency_mo_mt_call.py: using MSISDN 8183 13:40:28.760308 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:29.340926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27515): Launched 13:40:29.665367 run osmo-msc_10.42.42.6(pid=27516): Launched 13:40:29.848670 run osmo-stp_10.42.42.5(pid=27513): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27513)] 13:40:29.986552 run osmo-stp_10.42.42.5(pid=27513): stdout: | (launched: 2022-12-13_13:40:28.397150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:30.126090 run osmo-stp_10.42.42.5(pid=27513): stderr: | 20221213134028585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134028585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134028585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134028586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134028586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134028587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134028587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:30.263038 run osmo-stp_10.42.42.5(pid=27513): stdout: | (launched: 2022-12-13_13:40:28.397150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:30.392051 run osmo-stp_10.42.42.5(pid=27513): stderr: | 20221213134028585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134028585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134028585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134028586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134028586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134028587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134028587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:30.546239 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27513): Process ended prematurely: osmo-stp_10.42.42.5(pid=27513) [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27513)] [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 13:40:30.555360 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:40:30.582678 run osmo-hlr_10.42.42.2(pid=27510): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27510)] 13:40:30.632901 run osmo-hlr_10.42.42.2(pid=27510): stdout: | (launched: 2022-12-13_13:40:27.397607) 13:40:30.684537 run osmo-hlr_10.42.42.2(pid=27510): stderr: | 20221213134027593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134027593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134027593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134027593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134027593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134027593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134027605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134027614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134027614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134027614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:30.756285 run osmo-msc_10.42.42.6(pid=27516): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27516)] 13:40:30.805678 run osmo-msc_10.42.42.6(pid=27516): stdout: | (launched: 2022-12-13_13:40:29.606035) 13:40:30.879776 run osmo-msc_10.42.42.6(pid=27516): stderr: | 20221213134029922 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134029922 DLGLOBAL DEBUG validating counter group 0x7ff27cb1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134029922 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134029922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134029923 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134029923 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134029925 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134029925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134029925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134029925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:30.940840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27509): Terminating (SIGTERM) 13:40:30.981783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27512): Terminating (SIGTERM) 13:40:31.026516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27515): Terminating (SIGTERM) 13:40:31.072040 --- ParallelTerminationStrategy: PID 27509 died... 13:40:31.093036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27509): Terminated: ok {rc=0} 13:40:31.140406 --- ParallelTerminationStrategy: PID 27512 died... 13:40:31.160891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27512): Terminated: ok {rc=0} 13:40:31.206741 --- ParallelTerminationStrategy: PID 27515 died... 13:40:31.227361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27515): Terminated: ok {rc=0} 13:40:31.319819 bus /sierra_3: Setting Powered False 13:40:32.427426 bus /sierra_3: Setting Powered False 13:40:33.539506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 13:40:34.624805 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:34.637123 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:40:34.702095 tst emergency_preemptive_call.py: using LAC 34323 13:40:34.833296 tst emergency_preemptive_call.py: using RAC 153 13:40:34.961608 tst emergency_preemptive_call.py: using CellId 34323 13:40:35.088041 tst emergency_preemptive_call.py: using BVCI 34324 13:40:35.205458 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:35.216655 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:35.227991 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:35.239462 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:35.250980 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:40:35.262470 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:35.382452 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:35.502666 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:35.619756 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:35.740539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:36.243070 run create_hlr_db(pid=27518): Launched 13:40:36.368365 bus /sierra_2: Setting Powered False 13:40:37.432833 run create_hlr_db(pid=27518): Terminated: ok {rc=0} 13:40:37.864758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27520): Launched 13:40:38.190198 run osmo-hlr_10.42.42.2(pid=27521): Launched 13:40:38.314644 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:38.874828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27523): Launched 13:40:39.199746 run osmo-stp_10.42.42.5(pid=27524): Launched 13:40:39.333245 tst emergency_preemptive_call.py: using MSISDN 8184 13:40:39.504522 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:40.084772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27526): Launched 13:40:40.408804 run osmo-msc_10.42.42.6(pid=27527): Launched 13:40:40.589384 run osmo-stp_10.42.42.5(pid=27524): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27524)] 13:40:40.724697 run osmo-stp_10.42.42.5(pid=27524): stdout: | (launched: 2022-12-13_13:40:39.140059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:40.860756 run osmo-stp_10.42.42.5(pid=27524): stderr: | 20221213134039329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134039329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134039329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134039330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134039331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134039331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134039331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:40.996368 run osmo-stp_10.42.42.5(pid=27524): stdout: | (launched: 2022-12-13_13:40:39.140059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:41.124887 run osmo-stp_10.42.42.5(pid=27524): stderr: | 20221213134039329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134039329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134039329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134039330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134039331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134039331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134039331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:41.279031 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27524): Process ended prematurely: osmo-stp_10.42.42.5(pid=27524) [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27524)] [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 13:40:41.288271 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 13:40:41.315958 run osmo-hlr_10.42.42.2(pid=27521): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27521)] 13:40:41.366946 run osmo-hlr_10.42.42.2(pid=27521): stdout: | (launched: 2022-12-13_13:40:38.130856) 13:40:41.418710 run osmo-hlr_10.42.42.2(pid=27521): stderr: | 20221213134038325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134038326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134038326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134038326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134038326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134038326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134038338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134038346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134038347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134038347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:41.491662 run osmo-msc_10.42.42.6(pid=27527): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27527)] 13:40:41.541384 run osmo-msc_10.42.42.6(pid=27527): stdout: | (launched: 2022-12-13_13:40:40.349793) 13:40:41.593381 run osmo-msc_10.42.42.6(pid=27527): stderr: | 20221213134040671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134040672 DLGLOBAL DEBUG validating counter group 0x7f68fa530c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134040672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134040672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134040672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134040672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134040674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134040674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134040674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134040675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:41.645544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27520): Terminating (SIGTERM) 13:40:41.687535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27523): Terminating (SIGTERM) 13:40:41.729928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27526): Terminating (SIGTERM) 13:40:41.772330 --- ParallelTerminationStrategy: PID 27520 died... 13:40:41.792716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27520): Terminated: ok {rc=0} 13:40:41.838848 --- ParallelTerminationStrategy: PID 27523 died... 13:40:41.858676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27523): Terminated: ok {rc=0} 13:40:41.904542 --- ParallelTerminationStrategy: PID 27526 died... 13:40:41.924302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27526): Terminated: ok {rc=0} 13:40:42.012090 bus /sierra_9: Setting Powered False 13:40:43.112292 bus /sierra_9: Setting Powered False 13:40:44.230261 bus /sierra_8: Setting Powered False 13:40:45.327996 bus /sierra_8: Setting Powered False 13:40:46.448761 bus /sierra_3: Setting Powered False 13:40:47.562881 bus /sierra_3: Setting Powered False 13:40:48.680019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx --------------------------------------------------------------------- 13:40:49.962284 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:49.967070 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:40:50.000446 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 13:40:50.041412 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:40:50.134738 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:40:50.168655 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 13:40:50.208102 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:40:50.793141 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 13:40:50.844613 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:50.855321 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:40:50.902157 tst cs_paging_gprs_active.py: using LAC 34324 13:40:51.022403 tst cs_paging_gprs_active.py: using RAC 154 13:40:51.145429 tst cs_paging_gprs_active.py: using CellId 34324 13:40:51.266757 tst cs_paging_gprs_active.py: using BVCI 34325 13:40:51.378963 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.389645 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.400022 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.410447 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.420674 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.431019 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.441521 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.451785 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:40:51.462276 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:51.578782 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:40:51.700745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:40:51.922538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:52.229867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Launched 13:40:52.496651 run iperf3-srv_10.42.42.10(pid=27534): Launched 13:40:52.611163 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:40:52.816689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:53.124548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Launched 13:40:53.391957 run iperf3-srv_10.42.42.10(pid=27536): Launched 13:40:53.506706 tst cs_paging_gprs_active.py:38: start network... 13:40:53.711630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:54.187977 run create_hlr_db(pid=27537): Launched 13:40:54.314824 bus /sierra_2: Setting Powered False 13:40:55.375897 run create_hlr_db(pid=27537): Terminated: ok {rc=0} 13:40:55.803692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27539): Launched 13:40:56.111612 run osmo-hlr_10.42.42.2(pid=27540): Launched 13:40:56.228605 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:56.757241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27542): Launched 13:40:57.066249 run osmo-stp_10.42.42.5(pid=27543): Launched 13:40:57.183042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:57.713095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27545): Launched 13:40:57.830198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:58.089092 run patchelf(pid=27546): Launched 13:40:58.259277 run osmo-stp_10.42.42.5(pid=27543): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27543)] 13:40:58.388829 run osmo-stp_10.42.42.5(pid=27543): stdout: | (launched: 2022-12-13_13:40:57.009686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:58.520171 run osmo-stp_10.42.42.5(pid=27543): stderr: | 20221213134057176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134057176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134057176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134057177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134057177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134057177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134057177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:58.651539 run osmo-stp_10.42.42.5(pid=27543): stdout: | (launched: 2022-12-13_13:40:57.009686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:58.776658 run osmo-stp_10.42.42.5(pid=27543): stderr: | 20221213134057176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134057176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134057176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134057177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134057177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134057177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134057177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:58.926197 run patchelf(pid=27546): Terminating (SIGINT) 13:40:59.099015 run patchelf(pid=27546): Terminated: ok {rc=0} 13:40:59.223490 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27543): Process ended prematurely: osmo-stp_10.42.42.5(pid=27543) [trial-2390↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27543)] [trial-2390↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 13:40:59.233080 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:40:59.259994 run osmo-hlr_10.42.42.2(pid=27540): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27540)] 13:40:59.307031 run osmo-hlr_10.42.42.2(pid=27540): stdout: | (launched: 2022-12-13_13:40:56.054750) 13:40:59.356052 run osmo-hlr_10.42.42.2(pid=27540): stderr: | 20221213134056229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134056229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134056229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134056229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134056229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134056229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134056242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134056250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134056250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134056251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:59.405254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Terminating (SIGTERM) 13:40:59.444784 run iperf3-srv_10.42.42.10(pid=27534): Terminating (SIGTERM) 13:40:59.484103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Terminating (SIGTERM) 13:40:59.523510 run iperf3-srv_10.42.42.10(pid=27536): Terminating (SIGTERM) 13:40:59.562805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27539): Terminating (SIGTERM) 13:40:59.602267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27542): Terminating (SIGTERM) 13:40:59.641737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27545): Terminating (SIGTERM) 13:40:59.681850 --- ParallelTerminationStrategy: PID 27533 died... 13:40:59.700799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Terminated: ok {rc=0} 13:40:59.744512 --- ParallelTerminationStrategy: PID 27534 died... 13:40:59.762916 run iperf3-srv_10.42.42.10(pid=27534): Terminated {rc=256} 13:40:59.805842 --- ParallelTerminationStrategy: PID 27535 died... 13:40:59.824257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Terminated: ok {rc=0} 13:40:59.867754 --- ParallelTerminationStrategy: PID 27536 died... 13:40:59.886164 run iperf3-srv_10.42.42.10(pid=27536): Terminated {rc=256} 13:40:59.929329 --- ParallelTerminationStrategy: PID 27539 died... 13:40:59.947788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27539): Terminated: ok {rc=0} 13:40:59.990931 --- ParallelTerminationStrategy: PID 27542 died... 13:41:00.009543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27542): Terminated: ok {rc=0} 13:41:00.052845 --- ParallelTerminationStrategy: PID 27545 died... 13:41:00.072021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27545): Terminated: ok {rc=0} 13:41:00.158106 bus /gobi_0: Setting Powered False 13:41:01.260123 bus /gobi_0: Setting Powered False 13:41:02.375861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx iperf3.py ---------------------------------------------- 13:41:03.522181 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:03.533492 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:41:03.583589 tst iperf3.py: using LAC 34325 13:41:03.715096 tst iperf3.py: using RAC 155 13:41:03.849944 tst iperf3.py: using CellId 34325 13:41:03.979632 tst iperf3.py: using BVCI 34326 13:41:04.100233 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.111582 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.122793 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.133809 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.145019 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.156251 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.167646 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.178905 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:04.190260 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:04.308258 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:04.516151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:04.824595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27547): Launched 13:41:05.093654 run iperf3-srv_10.42.42.10(pid=27548): Launched 13:41:05.210274 tst iperf3.py:8: start network... 13:41:05.417719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:05.896545 run create_hlr_db(pid=27549): Launched 13:41:06.024072 bus /gobi_6: Setting Powered False 13:41:07.084942 run create_hlr_db(pid=27549): Terminated: ok {rc=0} 13:41:07.534293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27551): Launched 13:41:07.864821 run osmo-hlr_10.42.42.2(pid=27552): Launched 13:41:07.990325 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:08.556495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27554): Launched 13:41:08.887987 run osmo-stp_10.42.42.5(pid=27555): Launched 13:41:09.014730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:09.583155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27557): Launched 13:41:09.710371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:09.988737 run patchelf(pid=27558): Launched 13:41:10.173463 run osmo-stp_10.42.42.5(pid=27555): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27555)] 13:41:10.313366 run osmo-stp_10.42.42.5(pid=27555): stdout: | (launched: 2022-12-13_13:41:08.827546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:10.454021 run osmo-stp_10.42.42.5(pid=27555): stderr: | 20221213134109016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134109017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134109017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134109017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134109018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134109018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134109018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:10.595340 run osmo-stp_10.42.42.5(pid=27555): stdout: | (launched: 2022-12-13_13:41:08.827546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:10.730128 run osmo-stp_10.42.42.5(pid=27555): stderr: | 20221213134109016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134109017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134109017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134109017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134109018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134109018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134109018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:10.890449 run patchelf(pid=27558): Terminating (SIGINT) 13:41:11.075984 run patchelf(pid=27558): Terminated: ok {rc=0} 13:41:11.209012 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27555): Process ended prematurely: osmo-stp_10.42.42.5(pid=27555) [trial-2390↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27555)] [trial-2390↪gprs:trx-umtrx↪iperf3.py:8] 13:41:11.219148 tst iperf3.py:8: Test FAILED (7.7 sec) 13:41:11.247504 run osmo-hlr_10.42.42.2(pid=27552): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27552)] 13:41:11.298257 run osmo-hlr_10.42.42.2(pid=27552): stdout: | (launched: 2022-12-13_13:41:07.804295) 13:41:11.350033 run osmo-hlr_10.42.42.2(pid=27552): stderr: | 20221213134107999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134108000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134108000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134108000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134108000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134108000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134108012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134108021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134108021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134108021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:11.402035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27547): Terminating (SIGTERM) 13:41:11.443992 run iperf3-srv_10.42.42.10(pid=27548): Terminating (SIGTERM) 13:41:11.486540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27551): Terminating (SIGTERM) 13:41:11.528629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27554): Terminating (SIGTERM) 13:41:11.571170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27557): Terminating (SIGTERM) 13:41:11.613710 --- ParallelTerminationStrategy: PID 27547 died... 13:41:11.634137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27547): Terminated: ok {rc=0} 13:41:11.680794 --- ParallelTerminationStrategy: PID 27548 died... 13:41:11.700654 run iperf3-srv_10.42.42.10(pid=27548): Terminated {rc=256} 13:41:11.747022 --- ParallelTerminationStrategy: PID 27551 died... 13:41:11.766920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27551): Terminated: ok {rc=0} 13:41:11.813240 --- ParallelTerminationStrategy: PID 27554 died... 13:41:11.833189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27554): Terminated: ok {rc=0} 13:41:11.879457 --- ParallelTerminationStrategy: PID 27557 died... 13:41:11.899723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27557): Terminated: ok {rc=0} 13:41:11.987356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 13:41:13.139909 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.151672 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:41:13.200830 tst iperf3m4.py: using LAC 34326 13:41:13.330614 tst iperf3m4.py: using RAC 156 13:41:13.460247 tst iperf3m4.py: using CellId 34326 13:41:13.587720 tst iperf3m4.py: using BVCI 34327 13:41:13.709960 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.721318 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.732313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.743221 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.754515 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.765687 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.776920 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.788179 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:13.799516 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:13.919167 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:14.047647 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:14.164519 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:14.285564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:14.509565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:14.840691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27559): Launched 13:41:15.128232 run iperf3-srv_10.42.42.10(pid=27560): Launched 13:41:15.252345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:41:15.475454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:15.806425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27561): Launched 13:41:16.111829 run iperf3-srv_10.42.42.10(pid=27562): Launched 13:41:16.252324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:41:16.479942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:16.815699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Launched 13:41:17.125464 run iperf3-srv_10.42.42.10(pid=27564): Launched 13:41:17.263061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:41:17.485793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:17.816236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Launched 13:41:18.102718 run iperf3-srv_10.42.42.10(pid=27566): Launched 13:41:18.227722 tst iperf3m4.py:8: start network... 13:41:18.449617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:18.959599 run create_hlr_db(pid=27567): Launched 13:41:19.087446 bus /gobi_6: Setting Powered False 13:41:20.151817 run create_hlr_db(pid=27567): Terminated: ok {rc=0} 13:41:20.609618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Launched 13:41:20.941368 run osmo-hlr_10.42.42.2(pid=27570): Launched 13:41:21.067093 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:21.639097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Launched 13:41:21.971740 run osmo-stp_10.42.42.5(pid=27573): Launched 13:41:22.099797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:22.670397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Launched 13:41:22.798326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:23.077179 run patchelf(pid=27576): Launched 13:41:23.261992 run osmo-stp_10.42.42.5(pid=27573): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] 13:41:23.401606 run osmo-stp_10.42.42.5(pid=27573): stdout: | (launched: 2022-12-13_13:41:21.911318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:23.542612 run osmo-stp_10.42.42.5(pid=27573): stderr: | 20221213134122099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134122099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134122100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134122100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134122101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134122101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134122101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:23.683949 run osmo-stp_10.42.42.5(pid=27573): stdout: | (launched: 2022-12-13_13:41:21.911318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:23.818969 run osmo-stp_10.42.42.5(pid=27573): stderr: | 20221213134122099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134122099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134122100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134122100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134122101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134122101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134122101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:23.978917 run patchelf(pid=27576): Terminating (SIGINT) 13:41:24.164414 run patchelf(pid=27576): Terminated: ok {rc=0} 13:41:24.298035 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27573): Process ended prematurely: osmo-stp_10.42.42.5(pid=27573) [trial-2390↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] [trial-2390↪gprs:trx-umtrx↪iperf3m4.py:8] 13:41:24.308308 tst iperf3m4.py:8: Test FAILED (11.2 sec) 13:41:24.337266 run osmo-hlr_10.42.42.2(pid=27570): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27570)] 13:41:24.387829 run osmo-hlr_10.42.42.2(pid=27570): stdout: | (launched: 2022-12-13_13:41:20.880479) 13:41:24.439475 run osmo-hlr_10.42.42.2(pid=27570): stderr: | 20221213134121080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134121080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134121080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134121080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134121080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134121080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134121092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134121101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134121101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134121101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:24.491676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27559): Terminating (SIGTERM) 13:41:24.533898 run iperf3-srv_10.42.42.10(pid=27560): Terminating (SIGTERM) 13:41:24.575997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27561): Terminating (SIGTERM) 13:41:24.618815 run iperf3-srv_10.42.42.10(pid=27562): Terminating (SIGTERM) 13:41:24.661048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminating (SIGTERM) 13:41:24.703715 run iperf3-srv_10.42.42.10(pid=27564): Terminating (SIGTERM) 13:41:24.746284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminating (SIGTERM) 13:41:24.788395 run iperf3-srv_10.42.42.10(pid=27566): Terminating (SIGTERM) 13:41:24.830455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Terminating (SIGTERM) 13:41:24.873178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Terminating (SIGTERM) 13:41:24.915832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Terminating (SIGTERM) 13:41:24.958715 --- ParallelTerminationStrategy: PID 27559 died... 13:41:24.979184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27559): Terminated: ok {rc=0} 13:41:25.025644 --- ParallelTerminationStrategy: PID 27560 died... 13:41:25.045582 run iperf3-srv_10.42.42.10(pid=27560): Terminated {rc=256} 13:41:25.091794 --- ParallelTerminationStrategy: PID 27561 died... 13:41:25.111733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27561): Terminated: ok {rc=0} 13:41:25.158075 --- ParallelTerminationStrategy: PID 27562 died... 13:41:25.177960 run iperf3-srv_10.42.42.10(pid=27562): Terminated {rc=256} 13:41:25.223977 --- ParallelTerminationStrategy: PID 27563 died... 13:41:25.243903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminated: ok {rc=0} 13:41:25.290328 --- ParallelTerminationStrategy: PID 27564 died... 13:41:25.310090 run iperf3-srv_10.42.42.10(pid=27564): Terminated {rc=256} 13:41:25.356325 --- ParallelTerminationStrategy: PID 27565 died... 13:41:25.376324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminated: ok {rc=0} 13:41:25.422642 --- ParallelTerminationStrategy: PID 27566 died... 13:41:25.442544 run iperf3-srv_10.42.42.10(pid=27566): Terminated {rc=256} 13:41:25.488795 --- ParallelTerminationStrategy: PID 27569 died... 13:41:25.509218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Terminated: ok {rc=0} 13:41:25.555625 --- ParallelTerminationStrategy: PID 27572 died... 13:41:25.575695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Terminated: ok {rc=0} 13:41:25.622041 --- ParallelTerminationStrategy: PID 27575 died... 13:41:25.641977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Terminated: ok {rc=0} 13:41:25.731098 bus /gobi_4: Setting Powered False 13:41:26.828097 bus /gobi_4: Setting Powered False 13:41:27.943595 bus /gobi_1: Setting Powered False 13:41:29.041482 bus /gobi_1: Setting Powered False 13:41:30.155251 bus /gobi_0: Setting Powered False 13:41:31.253084 bus /gobi_0: Setting Powered False 13:41:32.371320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx ping.py ---------------------------------------------- 13:41:33.474807 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:33.486892 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:41:33.537099 tst ping.py: using LAC 34327 13:41:33.656845 tst ping.py: using RAC 157 13:41:33.775925 tst ping.py: using CellId 34327 13:41:33.894592 tst ping.py: using BVCI 34328 13:41:34.006214 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.016850 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.027369 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.037804 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.048557 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.059211 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.070543 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:34.081157 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:34.201376 tst ping.py:19: start network... 13:41:34.403550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:34.869095 run create_hlr_db(pid=27577): Launched 13:41:34.997469 bus /gobi_6: Setting Powered False 13:41:36.061676 run create_hlr_db(pid=27577): Terminated: ok {rc=0} 13:41:36.492284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27579): Launched 13:41:36.817873 run osmo-hlr_10.42.42.2(pid=27580): Launched 13:41:36.942045 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:37.505405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27582): Launched 13:41:37.830441 run osmo-stp_10.42.42.5(pid=27583): Launched 13:41:37.954960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:38.512443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27585): Launched 13:41:38.636679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:38.910203 run patchelf(pid=27586): Launched 13:41:39.091453 run osmo-stp_10.42.42.5(pid=27583): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27583)] 13:41:39.228934 run osmo-stp_10.42.42.5(pid=27583): stdout: | (launched: 2022-12-13_13:41:37.771010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:39.368334 run osmo-stp_10.42.42.5(pid=27583): stderr: | 20221213134137958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134137958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134137959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134137959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134137959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134137960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134137960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:39.507371 run osmo-stp_10.42.42.5(pid=27583): stdout: | (launched: 2022-12-13_13:41:37.771010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:39.639846 run osmo-stp_10.42.42.5(pid=27583): stderr: | 20221213134137958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134137958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134137959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134137959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134137959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134137960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134137960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:39.796683 run patchelf(pid=27586): Terminating (SIGINT) 13:41:39.978929 run patchelf(pid=27586): Terminated: ok {rc=0} 13:41:40.110405 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27583): Process ended prematurely: osmo-stp_10.42.42.5(pid=27583) [trial-2390↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27583)] [trial-2390↪gprs:trx-umtrx↪ping.py:22] 13:41:40.120146 tst ping.py:22: Test FAILED (6.6 sec) 13:41:40.148305 run osmo-hlr_10.42.42.2(pid=27580): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27580)] 13:41:40.198834 run osmo-hlr_10.42.42.2(pid=27580): stdout: | (launched: 2022-12-13_13:41:36.758611) 13:41:40.250543 run osmo-hlr_10.42.42.2(pid=27580): stderr: | 20221213134136952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134136953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134136953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134136953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134136953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134136953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134136964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134136973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134136973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134136973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:40.302878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27579): Terminating (SIGTERM) 13:41:40.345082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27582): Terminating (SIGTERM) 13:41:40.387637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27585): Terminating (SIGTERM) 13:41:40.430531 --- ParallelTerminationStrategy: PID 27579 died... 13:41:40.451083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27579): Terminated: ok {rc=0} 13:41:40.497567 --- ParallelTerminationStrategy: PID 27582 died... 13:41:40.517570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27582): Terminated: ok {rc=0} 13:41:40.564139 --- ParallelTerminationStrategy: PID 27585 died... 13:41:40.584108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27585): Terminated: ok {rc=0} 13:41:40.672323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 13:41:41.760071 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:41.771905 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:41:41.822541 tst ping_idle_ping.py: using LAC 34328 13:41:41.943439 tst ping_idle_ping.py: using RAC 158 13:41:42.064274 tst ping_idle_ping.py: using CellId 34328 13:41:42.183826 tst ping_idle_ping.py: using BVCI 34329 13:41:42.294694 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.305580 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.316313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.327138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.337979 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.348825 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.359525 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:41:42.370631 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:41:42.486182 tst ping_idle_ping.py:24: start network... 13:41:42.688778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:43.158831 run create_hlr_db(pid=27587): Launched 13:41:43.282666 bus /gobi_6: Setting Powered False 13:41:44.343285 run create_hlr_db(pid=27587): Terminated: ok {rc=0} 13:41:44.787073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Launched 13:41:45.114179 run osmo-hlr_10.42.42.2(pid=27590): Launched 13:41:45.238766 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:45.797218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27592): Launched 13:41:46.149403 run osmo-stp_10.42.42.5(pid=27593): Launched 13:41:46.298466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:47.017312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27595): Launched 13:41:47.150456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:47.411663 run patchelf(pid=27596): Launched 13:41:47.580324 run osmo-stp_10.42.42.5(pid=27593): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27593)] 13:41:47.708325 run osmo-stp_10.42.42.5(pid=27593): stdout: | (launched: 2022-12-13_13:41:46.089808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:47.838168 run osmo-stp_10.42.42.5(pid=27593): stderr: | 20221213134146475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134146475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134146475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134146478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134146479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134146479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134146479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:47.967865 run osmo-stp_10.42.42.5(pid=27593): stdout: | (launched: 2022-12-13_13:41:46.089808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:48.091617 run osmo-stp_10.42.42.5(pid=27593): stderr: | 20221213134146475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134146475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134146475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134146478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134146479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134146479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134146479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:48.238233 run patchelf(pid=27596): Terminating (SIGINT) 13:41:48.408108 run patchelf(pid=27596): Terminated: ok {rc=0} 13:41:48.530726 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27593): Process ended prematurely: osmo-stp_10.42.42.5(pid=27593) [trial-2390↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27593)] [trial-2390↪gprs:trx-umtrx↪ping_idle_ping.py:27] 13:41:48.539865 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:41:48.566680 run osmo-hlr_10.42.42.2(pid=27590): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27590)] 13:41:48.614539 run osmo-hlr_10.42.42.2(pid=27590): stdout: | (launched: 2022-12-13_13:41:45.054359) 13:41:48.663789 run osmo-hlr_10.42.42.2(pid=27590): stderr: | 20221213134145254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134145254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134145254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134145254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134145254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134145254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134145265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134145273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134145273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134145274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:48.713620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Terminating (SIGTERM) 13:41:48.753580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27592): Terminating (SIGTERM) 13:41:48.793524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27595): Terminating (SIGTERM) 13:41:48.833817 --- ParallelTerminationStrategy: PID 27589 died... 13:41:48.853166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Terminated: ok {rc=0} 13:41:48.897395 --- ParallelTerminationStrategy: PID 27592 died... 13:41:48.916080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27592): Terminated: ok {rc=0} 13:41:48.960112 --- ParallelTerminationStrategy: PID 27595 died... 13:41:48.978913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27595): Terminated: ok {rc=0} 13:41:49.064355 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 13:41:50.361868 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:50.366965 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:41:50.398814 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:41:50.437487 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:41:50.524409 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:41:50.556922 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:41:50.595450 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:41:51.189778 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:41:51.239108 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.250005 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:41:51.299557 tst cs_paging_gprs_active.py: using LAC 34329 13:41:51.422514 tst cs_paging_gprs_active.py: using RAC 159 13:41:51.545751 tst cs_paging_gprs_active.py: using CellId 34329 13:41:51.669924 tst cs_paging_gprs_active.py: using BVCI 34330 13:41:51.792232 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.803906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.815278 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.826741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.838353 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.849974 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.862064 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.873647 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:41:51.885792 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:41:52.006321 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:41:52.127784 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:41:52.352209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:52.684343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Launched 13:41:52.972099 run iperf3-srv_10.42.42.10(pid=27601): Launched 13:41:53.095809 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:41:53.319030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:53.651315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Launched 13:41:53.940766 run iperf3-srv_10.42.42.10(pid=27603): Launched 13:41:54.065812 tst cs_paging_gprs_active.py:38: start network... 13:41:54.288228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:54.800022 run create_hlr_db(pid=27604): Launched 13:41:54.928121 bus /gobi_6: Setting Powered False 13:41:55.993459 run create_hlr_db(pid=27604): Terminated: ok {rc=0} 13:41:56.432928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Launched 13:41:56.741559 run osmo-hlr_10.42.42.2(pid=27607): Launched 13:41:56.860277 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:57.434225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Launched 13:41:57.764287 run osmo-stp_10.42.42.5(pid=27610): Launched 13:41:57.891467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:58.459624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Launched 13:41:58.587434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:58.866349 run patchelf(pid=27613): Launched 13:41:59.050608 run osmo-stp_10.42.42.5(pid=27610): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] 13:41:59.190247 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-13_13:41:57.703974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:59.331787 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221213134157892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134157892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134157893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134157893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134157894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134157894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134157894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:59.472813 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-13_13:41:57.703974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:59.608009 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221213134157892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134157892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134157893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134157893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134157894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134157894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134157894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:59.767759 run patchelf(pid=27613): Terminating (SIGINT) 13:41:59.952865 run patchelf(pid=27613): Terminated: ok {rc=0} 13:42:00.086652 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:42:00.096825 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:42:00.125386 run osmo-hlr_10.42.42.2(pid=27607): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27607)] 13:42:00.175591 run osmo-hlr_10.42.42.2(pid=27607): stdout: | (launched: 2022-12-13_13:41:56.684642) 13:42:00.227167 run osmo-hlr_10.42.42.2(pid=27607): stderr: | 20221213134156859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134156859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134156859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134156859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134156859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134156859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134156871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134156879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134156880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134156880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:00.279473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Terminating (SIGTERM) 13:42:00.321466 run iperf3-srv_10.42.42.10(pid=27601): Terminating (SIGTERM) 13:42:00.363371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Terminating (SIGTERM) 13:42:00.405556 run iperf3-srv_10.42.42.10(pid=27603): Terminating (SIGTERM) 13:42:00.447335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminating (SIGTERM) 13:42:00.489895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminating (SIGTERM) 13:42:00.531544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Terminating (SIGTERM) 13:42:00.573981 --- ParallelTerminationStrategy: PID 27600 died... 13:42:00.594279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Terminated: ok {rc=0} 13:42:00.640151 --- ParallelTerminationStrategy: PID 27601 died... 13:42:00.659826 run iperf3-srv_10.42.42.10(pid=27601): Terminated {rc=256} 13:42:00.705540 --- ParallelTerminationStrategy: PID 27602 died... 13:42:00.725261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Terminated: ok {rc=0} 13:42:00.770851 --- ParallelTerminationStrategy: PID 27603 died... 13:42:00.790488 run iperf3-srv_10.42.42.10(pid=27603): Terminated {rc=256} 13:42:00.844095 --- ParallelTerminationStrategy: PID 27606 died... 13:42:00.886876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminated: ok {rc=0} 13:42:00.951319 --- ParallelTerminationStrategy: PID 27609 died... 13:42:00.971590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminated: ok {rc=0} 13:42:01.072878 --- ParallelTerminationStrategy: PID 27612 died... 13:42:01.177579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Terminated: ok {rc=0} 13:42:01.342049 bus /gobi_0: Setting Powered False 13:42:02.455752 bus /gobi_0: Setting Powered False 13:42:03.573083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:42:04.719138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:04.730817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:04.783511 tst iperf3.py: using LAC 34330 13:42:04.908101 tst iperf3.py: using RAC 160 13:42:05.031691 tst iperf3.py: using CellId 34330 13:42:05.154339 tst iperf3.py: using BVCI 34331 13:42:05.268628 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.279636 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.290426 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.301245 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.311784 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.323062 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.333929 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.345015 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:05.355826 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:05.472694 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:05.679982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:05.988498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Launched 13:42:06.256643 run iperf3-srv_10.42.42.10(pid=27623): Launched 13:42:06.372040 tst iperf3.py:8: start network... 13:42:06.577835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:07.051301 run create_hlr_db(pid=27624): Launched 13:42:07.177127 bus /gobi_6: Setting Powered False 13:42:08.237669 run create_hlr_db(pid=27624): Terminated: ok {rc=0} 13:42:08.684485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Launched 13:42:09.014670 run osmo-hlr_10.42.42.2(pid=27627): Launched 13:42:09.141999 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:09.716864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Launched 13:42:10.046611 run osmo-stp_10.42.42.5(pid=27630): Launched 13:42:10.172713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:10.738884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Launched 13:42:10.865690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:11.143348 run patchelf(pid=27633): Launched 13:42:11.327404 run osmo-stp_10.42.42.5(pid=27630): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] 13:42:11.466748 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-13_13:42:09.986296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:11.607331 run osmo-stp_10.42.42.5(pid=27630): stderr: | 20221213134210177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134210177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134210178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134210178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134210178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134210178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134210179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:11.747660 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-13_13:42:09.986296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:11.881868 run osmo-stp_10.42.42.5(pid=27630): stderr: | 20221213134210177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134210177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134210178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134210178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134210178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134210178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134210179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:12.040672 run patchelf(pid=27633): Terminating (SIGINT) 13:42:12.225259 run patchelf(pid=27633): Terminated: ok {rc=0} 13:42:12.359336 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 13:42:12.369796 tst iperf3.py:8: Test FAILED (7.7 sec) 13:42:12.398543 run osmo-hlr_10.42.42.2(pid=27627): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27627)] 13:42:12.448506 run osmo-hlr_10.42.42.2(pid=27627): stdout: | (launched: 2022-12-13_13:42:08.954604) 13:42:12.500284 run osmo-hlr_10.42.42.2(pid=27627): stderr: | 20221213134209149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134209149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134209149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134209150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134209150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134209150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134209161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134209169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134209170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134209170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:12.552049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Terminating (SIGTERM) 13:42:12.593826 run iperf3-srv_10.42.42.10(pid=27623): Terminating (SIGTERM) 13:42:12.635174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminating (SIGTERM) 13:42:12.676743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminating (SIGTERM) 13:42:12.717980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Terminating (SIGTERM) 13:42:12.760483 --- ParallelTerminationStrategy: PID 27622 died... 13:42:12.780665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Terminated: ok {rc=0} 13:42:12.826930 --- ParallelTerminationStrategy: PID 27623 died... 13:42:12.846598 run iperf3-srv_10.42.42.10(pid=27623): Terminated {rc=256} 13:42:12.892665 --- ParallelTerminationStrategy: PID 27626 died... 13:42:12.912365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminated: ok {rc=0} 13:42:12.958051 --- ParallelTerminationStrategy: PID 27629 died... 13:42:12.977705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminated: ok {rc=0} 13:42:13.023443 --- ParallelTerminationStrategy: PID 27632 died... 13:42:13.043063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Terminated: ok {rc=0} 13:42:13.130503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:42:14.279686 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.291939 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:14.343159 tst iperf3m4.py: using LAC 34331 13:42:14.474021 tst iperf3m4.py: using RAC 161 13:42:14.605936 tst iperf3m4.py: using CellId 34331 13:42:14.737195 tst iperf3m4.py: using BVCI 34332 13:42:14.857105 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.868516 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.879677 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.890836 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.902314 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.913670 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.925233 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.936462 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:14.948583 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:15.068669 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:15.192840 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:15.312101 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:15.433181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:15.642205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:15.981852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Launched 13:42:16.319166 run iperf3-srv_10.42.42.10(pid=27635): Launched 13:42:16.472062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:42:16.709173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:17.047366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Launched 13:42:17.347572 run iperf3-srv_10.42.42.10(pid=27637): Launched 13:42:17.473207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:42:17.696265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:18.026507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Launched 13:42:18.313598 run iperf3-srv_10.42.42.10(pid=27639): Launched 13:42:18.439414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:42:18.661911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:18.993012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27640): Launched 13:42:19.279798 run iperf3-srv_10.42.42.10(pid=27641): Launched 13:42:19.406963 tst iperf3m4.py:8: start network... 13:42:19.630228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:20.141750 run create_hlr_db(pid=27642): Launched 13:42:20.270227 bus /gobi_6: Setting Powered False 13:42:21.335566 run create_hlr_db(pid=27642): Terminated: ok {rc=0} 13:42:21.794580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Launched 13:42:22.126733 run osmo-hlr_10.42.42.2(pid=27645): Launched 13:42:22.254382 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:22.827718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Launched 13:42:23.160743 run osmo-stp_10.42.42.5(pid=27648): Launched 13:42:23.287805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:23.858579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27650): Launched 13:42:23.986731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:24.266957 run patchelf(pid=27651): Launched 13:42:24.452779 run osmo-stp_10.42.42.5(pid=27648): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] 13:42:24.592532 run osmo-stp_10.42.42.5(pid=27648): stdout: | (launched: 2022-12-13_13:42:23.099872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:24.734262 run osmo-stp_10.42.42.5(pid=27648): stderr: | 20221213134223288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134223289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134223289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134223289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134223290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134223290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134223290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:24.875671 run osmo-stp_10.42.42.5(pid=27648): stdout: | (launched: 2022-12-13_13:42:23.099872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:25.011464 run osmo-stp_10.42.42.5(pid=27648): stderr: | 20221213134223288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134223289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134223289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134223289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134223290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134223290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134223290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:25.172339 run patchelf(pid=27651): Terminating (SIGINT) 13:42:25.358841 run patchelf(pid=27651): Terminated: ok {rc=0} 13:42:25.492589 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27648): Process ended prematurely: osmo-stp_10.42.42.5(pid=27648) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 13:42:25.502936 tst iperf3m4.py:8: Test FAILED (11.3 sec) 13:42:25.531654 run osmo-hlr_10.42.42.2(pid=27645): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27645)] 13:42:25.582174 run osmo-hlr_10.42.42.2(pid=27645): stdout: | (launched: 2022-12-13_13:42:22.065899) 13:42:25.633405 run osmo-hlr_10.42.42.2(pid=27645): stderr: | 20221213134222261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134222261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134222261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134222261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134222261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134222262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134222273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134222282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134222282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134222282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:25.685191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Terminating (SIGTERM) 13:42:25.727377 run iperf3-srv_10.42.42.10(pid=27635): Terminating (SIGTERM) 13:42:25.769905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Terminating (SIGTERM) 13:42:25.812407 run iperf3-srv_10.42.42.10(pid=27637): Terminating (SIGTERM) 13:42:25.855057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Terminating (SIGTERM) 13:42:25.897523 run iperf3-srv_10.42.42.10(pid=27639): Terminating (SIGTERM) 13:42:25.940078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27640): Terminating (SIGTERM) 13:42:25.982421 run iperf3-srv_10.42.42.10(pid=27641): Terminating (SIGTERM) 13:42:26.024902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Terminating (SIGTERM) 13:42:26.067211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Terminating (SIGTERM) 13:42:26.109317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27650): Terminating (SIGTERM) 13:42:26.152345 --- ParallelTerminationStrategy: PID 27634 died... 13:42:26.172855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Terminated: ok {rc=0} 13:42:26.219482 --- ParallelTerminationStrategy: PID 27635 died... 13:42:26.239364 run iperf3-srv_10.42.42.10(pid=27635): Terminated {rc=256} 13:42:26.285579 --- ParallelTerminationStrategy: PID 27636 died... 13:42:26.305783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Terminated: ok {rc=0} 13:42:26.352457 --- ParallelTerminationStrategy: PID 27637 died... 13:42:26.372406 run iperf3-srv_10.42.42.10(pid=27637): Terminated {rc=256} 13:42:26.418735 --- ParallelTerminationStrategy: PID 27638 died... 13:42:26.438736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Terminated: ok {rc=0} 13:42:26.485363 --- ParallelTerminationStrategy: PID 27639 died... 13:42:26.505416 run iperf3-srv_10.42.42.10(pid=27639): Terminated {rc=256} 13:42:26.551745 --- ParallelTerminationStrategy: PID 27640 died... 13:42:26.571875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27640): Terminated: ok {rc=0} 13:42:26.618824 --- ParallelTerminationStrategy: PID 27641 died... 13:42:26.638920 run iperf3-srv_10.42.42.10(pid=27641): Terminated {rc=256} 13:42:26.685350 --- ParallelTerminationStrategy: PID 27644 died... 13:42:26.705429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27644): Terminated: ok {rc=0} 13:42:26.752181 --- ParallelTerminationStrategy: PID 27647 died... 13:42:26.772215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27647): Terminated: ok {rc=0} 13:42:26.818898 --- ParallelTerminationStrategy: PID 27650 died... 13:42:26.838966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27650): Terminated: ok {rc=0} 13:42:26.926578 bus /gobi_4: Setting Powered False 13:42:28.026400 bus /gobi_4: Setting Powered False 13:42:29.142843 bus /gobi_1: Setting Powered False 13:42:30.242144 bus /gobi_1: Setting Powered False 13:42:31.358268 bus /gobi_0: Setting Powered False 13:42:32.456674 bus /gobi_0: Setting Powered False 13:42:33.572746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 13:42:34.676098 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:34.687832 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:34.737537 tst ping.py: using LAC 34332 13:42:34.865400 tst ping.py: using RAC 162 13:42:34.991483 tst ping.py: using CellId 34332 13:42:35.110724 tst ping.py: using BVCI 34333 13:42:35.220914 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.231893 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.242665 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.253347 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.263820 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.274394 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.285152 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.296179 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:35.417400 tst ping.py:19: start network... 13:42:35.636077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:36.139453 run create_hlr_db(pid=27652): Launched 13:42:36.264389 bus /gobi_6: Setting Powered False 13:42:37.329335 run create_hlr_db(pid=27652): Terminated: ok {rc=0} 13:42:37.764846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27654): Launched 13:42:38.067387 run osmo-hlr_10.42.42.2(pid=27655): Launched 13:42:38.181583 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:38.707207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27657): Launched 13:42:39.007888 run osmo-stp_10.42.42.5(pid=27658): Launched 13:42:39.121842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:39.640791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27660): Launched 13:42:39.756289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:40.011635 run patchelf(pid=27661): Launched 13:42:40.181070 run osmo-stp_10.42.42.5(pid=27658): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27658)] 13:42:40.308521 run osmo-stp_10.42.42.5(pid=27658): stdout: | (launched: 2022-12-13_13:42:38.952269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:40.438218 run osmo-stp_10.42.42.5(pid=27658): stderr: | 20221213134239121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134239121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134239121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134239121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134239122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134239122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134239122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:40.567827 run osmo-stp_10.42.42.5(pid=27658): stdout: | (launched: 2022-12-13_13:42:38.952269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:40.690617 run osmo-stp_10.42.42.5(pid=27658): stderr: | 20221213134239121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134239121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134239121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134239121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134239122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134239122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134239122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:40.836237 run patchelf(pid=27661): Terminating (SIGINT) 13:42:41.006105 run patchelf(pid=27661): Terminated: ok {rc=0} 13:42:41.128194 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27658): Process ended prematurely: osmo-stp_10.42.42.5(pid=27658) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27658)] [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 13:42:41.137260 tst ping.py:22: Test FAILED (6.5 sec) 13:42:41.164034 run osmo-hlr_10.42.42.2(pid=27655): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27655)] 13:42:41.211801 run osmo-hlr_10.42.42.2(pid=27655): stdout: | (launched: 2022-12-13_13:42:38.011476) 13:42:41.260476 run osmo-hlr_10.42.42.2(pid=27655): stderr: | 20221213134238184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134238184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134238184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134238184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134238184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134238184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134238196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134238204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134238205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134238205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:41.309740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27654): Terminating (SIGTERM) 13:42:41.349518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27657): Terminating (SIGTERM) 13:42:41.389323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27660): Terminating (SIGTERM) 13:42:41.429365 --- ParallelTerminationStrategy: PID 27654 died... 13:42:41.447901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27654): Terminated: ok {rc=0} 13:42:41.492312 --- ParallelTerminationStrategy: PID 27657 died... 13:42:41.510741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27657): Terminated: ok {rc=0} 13:42:41.554607 --- ParallelTerminationStrategy: PID 27660 died... 13:42:41.573251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27660): Terminated: ok {rc=0} 13:42:41.655845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:42:42.742969 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:42.755217 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:42.810825 tst ping_idle_ping.py: using LAC 34333 13:42:42.929198 tst ping_idle_ping.py: using RAC 163 13:42:43.048722 tst ping_idle_ping.py: using CellId 34333 13:42:43.169897 tst ping_idle_ping.py: using BVCI 34334 13:42:43.281887 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.292695 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.303675 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.314578 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.325144 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.335675 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.346564 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:43.357307 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:43.478651 tst ping_idle_ping.py:24: start network... 13:42:43.698640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:44.203088 run create_hlr_db(pid=27662): Launched 13:42:44.327654 bus /gobi_6: Setting Powered False 13:42:45.392121 run create_hlr_db(pid=27662): Terminated: ok {rc=0} 13:42:45.828390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27664): Launched 13:42:46.176327 run osmo-hlr_10.42.42.2(pid=27665): Launched 13:42:46.418857 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:47.052128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27667): Launched 13:42:47.395028 run osmo-stp_10.42.42.5(pid=27668): Launched 13:42:47.520311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:48.082887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27670): Launched 13:42:48.209174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:48.484285 run patchelf(pid=27671): Launched 13:42:48.666945 run osmo-stp_10.42.42.5(pid=27668): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27668)] 13:42:48.804274 run osmo-stp_10.42.42.5(pid=27668): stdout: | (launched: 2022-12-13_13:42:47.335370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:48.943520 run osmo-stp_10.42.42.5(pid=27668): stderr: | 20221213134247522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134247522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134247523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134247523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134247524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134247524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134247524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:49.083229 run osmo-stp_10.42.42.5(pid=27668): stdout: | (launched: 2022-12-13_13:42:47.335370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:49.216529 run osmo-stp_10.42.42.5(pid=27668): stderr: | 20221213134247522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134247522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134247523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134247523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134247524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134247524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134247524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:49.374650 run patchelf(pid=27671): Terminating (SIGINT) 13:42:49.556911 run patchelf(pid=27671): Terminated: ok {rc=0} 13:42:49.688281 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27668): Process ended prematurely: osmo-stp_10.42.42.5(pid=27668) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27668)] [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 13:42:49.698065 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 13:42:49.725844 run osmo-hlr_10.42.42.2(pid=27665): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27665)] 13:42:49.776263 run osmo-hlr_10.42.42.2(pid=27665): stdout: | (launched: 2022-12-13_13:42:46.112755) 13:42:49.827886 run osmo-hlr_10.42.42.2(pid=27665): stderr: | 20221213134246368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134246369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134246369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134246369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134246369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134246369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134246394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134246402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134246403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134246403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:49.879840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27664): Terminating (SIGTERM) 13:42:49.921882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27667): Terminating (SIGTERM) 13:42:49.963769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27670): Terminating (SIGTERM) 13:42:50.005922 --- ParallelTerminationStrategy: PID 27664 died... 13:42:50.026187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27664): Terminated: ok {rc=0} 13:42:50.072378 --- ParallelTerminationStrategy: PID 27667 died... 13:42:50.092177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27667): Terminated: ok {rc=0} 13:42:50.138008 --- ParallelTerminationStrategy: PID 27670 died... 13:42:50.158031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27670): Terminated: ok {rc=0} 13:42:50.246184 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:42:51.551392 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:51.558816 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:42:51.591362 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:42:51.630795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:42:51.719407 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:42:51.751584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:42:51.790230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:42:52.384098 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:42:52.433252 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:52.444093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:42:52.511822 tst cs_paging_gprs_active.py: using LAC 34334 13:42:52.631442 tst cs_paging_gprs_active.py: using RAC 164 13:42:52.752469 tst cs_paging_gprs_active.py: using CellId 34334 13:42:52.871086 tst cs_paging_gprs_active.py: using BVCI 34335 13:42:52.985086 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:52.995907 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.006720 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.017488 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.028093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.039266 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.050173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.061353 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:42:53.072226 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:42:53.194466 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:42:53.313177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:42:53.521236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:53.833148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Launched 13:42:54.103097 run iperf3-srv_10.42.42.10(pid=27676): Launched 13:42:54.220486 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:42:54.427307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:54.738051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27677): Launched 13:42:55.007215 run iperf3-srv_10.42.42.10(pid=27678): Launched 13:42:55.123127 tst cs_paging_gprs_active.py:38: start network... 13:42:55.329865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:55.809223 run create_hlr_db(pid=27679): Launched 13:42:55.937242 bus /gobi_6: Setting Powered False 13:42:56.998494 run create_hlr_db(pid=27679): Terminated: ok {rc=0} 13:42:57.450710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27681): Launched 13:42:57.784074 run osmo-hlr_10.42.42.2(pid=27682): Launched 13:42:57.912438 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:58.487280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27684): Launched 13:42:58.818721 run osmo-stp_10.42.42.5(pid=27685): Launched 13:42:58.945629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:59.517270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27687): Launched 13:42:59.643962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:59.931809 run patchelf(pid=27688): Launched 13:43:00.117326 run osmo-stp_10.42.42.5(pid=27685): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27685)] 13:43:00.256619 run osmo-stp_10.42.42.5(pid=27685): stdout: | (launched: 2022-12-13_13:42:58.758166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:00.398511 run osmo-stp_10.42.42.5(pid=27685): stderr: | 20221213134258947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134258947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134258948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134258948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134258949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134258949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134258949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:00.539818 run osmo-stp_10.42.42.5(pid=27685): stdout: | (launched: 2022-12-13_13:42:58.758166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:00.675246 run osmo-stp_10.42.42.5(pid=27685): stderr: | 20221213134258947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134258947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134258948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134258948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134258949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134258949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134258949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:00.836091 run patchelf(pid=27688): Terminating (SIGINT) 13:43:01.031251 run patchelf(pid=27688): Terminated: ok {rc=0} 13:43:01.171493 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27685): Process ended prematurely: osmo-stp_10.42.42.5(pid=27685) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27685)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:43:01.182913 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:43:01.212577 run osmo-hlr_10.42.42.2(pid=27682): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27682)] 13:43:01.266797 run osmo-hlr_10.42.42.2(pid=27682): stdout: | (launched: 2022-12-13_13:42:57.723585) 13:43:01.320747 run osmo-hlr_10.42.42.2(pid=27682): stderr: | 20221213134257920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134257920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134257920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134257920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134257920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134257921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134257933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134257942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134257942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134257942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:01.375396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Terminating (SIGTERM) 13:43:01.418651 run iperf3-srv_10.42.42.10(pid=27676): Terminating (SIGTERM) 13:43:01.465485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27677): Terminating (SIGTERM) 13:43:01.509882 run iperf3-srv_10.42.42.10(pid=27678): Terminating (SIGTERM) 13:43:01.556446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27681): Terminating (SIGTERM) 13:43:01.599833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27684): Terminating (SIGTERM) 13:43:01.643788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27687): Terminating (SIGTERM) 13:43:01.687776 --- ParallelTerminationStrategy: PID 27675 died... 13:43:01.709588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Terminated: ok {rc=0} 13:43:01.757611 --- ParallelTerminationStrategy: PID 27676 died... 13:43:01.780267 run iperf3-srv_10.42.42.10(pid=27676): Terminated {rc=256} 13:43:01.835746 --- ParallelTerminationStrategy: PID 27677 died... 13:43:01.860872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27677): Terminated: ok {rc=0} 13:43:01.916205 --- ParallelTerminationStrategy: PID 27678 died... 13:43:01.939968 run iperf3-srv_10.42.42.10(pid=27678): Terminated {rc=256} 13:43:01.992873 --- ParallelTerminationStrategy: PID 27681 died... 13:43:02.016832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27681): Terminated: ok {rc=0} 13:43:02.072102 --- ParallelTerminationStrategy: PID 27684 died... 13:43:02.095668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27684): Terminated: ok {rc=0} 13:43:02.149765 --- ParallelTerminationStrategy: PID 27687 died... 13:43:02.172628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27687): Terminated: ok {rc=0} 13:43:02.266037 bus /gobi_0: Setting Powered False 13:43:03.366730 bus /gobi_0: Setting Powered False 13:43:04.481980 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:43:05.624736 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:05.636226 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:05.708695 tst iperf3.py: using LAC 34335 13:43:05.830249 tst iperf3.py: using RAC 165 13:43:05.956602 tst iperf3.py: using CellId 34335 13:43:06.076616 tst iperf3.py: using BVCI 34336 13:43:06.189238 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.200092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.210849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.221630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.232238 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.243424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.254615 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.265334 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:06.276062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:06.393668 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:06.600047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:06.908101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27689): Launched 13:43:07.178661 run iperf3-srv_10.42.42.10(pid=27690): Launched 13:43:07.296086 tst iperf3.py:8: start network... 13:43:07.502186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:07.978854 run create_hlr_db(pid=27691): Launched 13:43:08.104767 bus /gobi_6: Setting Powered False 13:43:09.166064 run create_hlr_db(pid=27691): Terminated: ok {rc=0} 13:43:09.614088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27693): Launched 13:43:09.946267 run osmo-hlr_10.42.42.2(pid=27694): Launched 13:43:10.074044 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:10.741063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27696): Launched 13:43:11.064154 run osmo-stp_10.42.42.5(pid=27697): Launched 13:43:11.186797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:11.745765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27699): Launched 13:43:11.869857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:12.144006 run patchelf(pid=27700): Launched 13:43:12.323430 run osmo-stp_10.42.42.5(pid=27697): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27697)] 13:43:12.460041 run osmo-stp_10.42.42.5(pid=27697): stdout: | (launched: 2022-12-13_13:43:11.004003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:12.598458 run osmo-stp_10.42.42.5(pid=27697): stderr: | 20221213134311192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134311192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134311193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134311193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134311193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134311194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134311194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:12.736222 run osmo-stp_10.42.42.5(pid=27697): stdout: | (launched: 2022-12-13_13:43:11.004003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:12.868710 run osmo-stp_10.42.42.5(pid=27697): stderr: | 20221213134311192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134311192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134311193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134311193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134311193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134311194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134311194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:13.025303 run patchelf(pid=27700): Terminating (SIGINT) 13:43:13.206598 run patchelf(pid=27700): Terminated: ok {rc=0} 13:43:13.337653 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27697): Process ended prematurely: osmo-stp_10.42.42.5(pid=27697) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27697)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 13:43:13.347909 tst iperf3.py:8: Test FAILED (7.8 sec) 13:43:13.376229 run osmo-hlr_10.42.42.2(pid=27694): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27694)] 13:43:13.425902 run osmo-hlr_10.42.42.2(pid=27694): stdout: | (launched: 2022-12-13_13:43:09.885681) 13:43:13.477121 run osmo-hlr_10.42.42.2(pid=27694): stderr: | 20221213134310081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134310081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134310081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134310081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134310081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134310081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134310100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134310110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134310110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134310110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:13.528612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27689): Terminating (SIGTERM) 13:43:13.570457 run iperf3-srv_10.42.42.10(pid=27690): Terminating (SIGTERM) 13:43:13.612301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27693): Terminating (SIGTERM) 13:43:13.654428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27696): Terminating (SIGTERM) 13:43:13.696666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27699): Terminating (SIGTERM) 13:43:13.739384 --- ParallelTerminationStrategy: PID 27689 died... 13:43:13.759644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27689): Terminated: ok {rc=0} 13:43:13.805799 --- ParallelTerminationStrategy: PID 27690 died... 13:43:13.825607 run iperf3-srv_10.42.42.10(pid=27690): Terminated {rc=256} 13:43:13.871643 --- ParallelTerminationStrategy: PID 27693 died... 13:43:13.891440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27693): Terminated: ok {rc=0} 13:43:13.937415 --- ParallelTerminationStrategy: PID 27696 died... 13:43:13.957094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27696): Terminated: ok {rc=0} 13:43:14.003315 --- ParallelTerminationStrategy: PID 27699 died... 13:43:14.023115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27699): Terminated: ok {rc=0} 13:43:14.111550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:43:15.260694 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.272652 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:15.345125 tst iperf3m4.py: using LAC 34336 13:43:15.473819 tst iperf3m4.py: using RAC 166 13:43:15.601165 tst iperf3m4.py: using CellId 34336 13:43:15.728242 tst iperf3m4.py: using BVCI 34337 13:43:15.855712 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.867786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.879613 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.891395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.903588 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.915693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.927951 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.939979 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:15.952189 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:16.084062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:16.217442 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:16.357067 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:16.509957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:16.787702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:17.130800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27701): Launched 13:43:17.426908 run iperf3-srv_10.42.42.10(pid=27702): Launched 13:43:17.541899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:43:17.744572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:18.049265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27703): Launched 13:43:18.312198 run iperf3-srv_10.42.42.10(pid=27704): Launched 13:43:18.428694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:43:18.630534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:18.934292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27705): Launched 13:43:19.198489 run iperf3-srv_10.42.42.10(pid=27706): Launched 13:43:19.312391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:43:19.514858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:19.817825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27707): Launched 13:43:20.082646 run iperf3-srv_10.42.42.10(pid=27708): Launched 13:43:20.196156 tst iperf3m4.py:8: start network... 13:43:20.397431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:20.867655 run create_hlr_db(pid=27709): Launched 13:43:20.993807 bus /gobi_6: Setting Powered False 13:43:22.056807 run create_hlr_db(pid=27709): Terminated: ok {rc=0} 13:43:22.489136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27711): Launched 13:43:22.792115 run osmo-hlr_10.42.42.2(pid=27712): Launched 13:43:22.906207 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:23.425631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27714): Launched 13:43:23.729206 run osmo-stp_10.42.42.5(pid=27715): Launched 13:43:23.843128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:24.363666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27717): Launched 13:43:24.479078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:24.734602 run patchelf(pid=27718): Launched 13:43:24.904236 run osmo-stp_10.42.42.5(pid=27715): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27715)] 13:43:25.031911 run osmo-stp_10.42.42.5(pid=27715): stdout: | (launched: 2022-12-13_13:43:23.673075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:25.161689 run osmo-stp_10.42.42.5(pid=27715): stderr: | 20221213134323839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134323839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134323840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134323840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134323841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134323841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134323841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:25.291207 run osmo-stp_10.42.42.5(pid=27715): stdout: | (launched: 2022-12-13_13:43:23.673075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:25.415183 run osmo-stp_10.42.42.5(pid=27715): stderr: | 20221213134323839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134323839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134323840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134323840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134323841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134323841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134323841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:25.561681 run patchelf(pid=27718): Terminating (SIGINT) 13:43:25.731636 run patchelf(pid=27718): Terminated: ok {rc=0} 13:43:25.853700 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27715): Process ended prematurely: osmo-stp_10.42.42.5(pid=27715) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27715)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:43:25.863290 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:43:25.890128 run osmo-hlr_10.42.42.2(pid=27712): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27712)] 13:43:25.937225 run osmo-hlr_10.42.42.2(pid=27712): stdout: | (launched: 2022-12-13_13:43:22.735586) 13:43:25.985816 run osmo-hlr_10.42.42.2(pid=27712): stderr: | 20221213134322909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134322909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134322909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134322910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134322910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134322910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134322925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134322935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134322935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134322935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:26.035350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27701): Terminating (SIGTERM) 13:43:26.075097 run iperf3-srv_10.42.42.10(pid=27702): Terminating (SIGTERM) 13:43:26.114775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27703): Terminating (SIGTERM) 13:43:26.154671 run iperf3-srv_10.42.42.10(pid=27704): Terminating (SIGTERM) 13:43:26.194259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27705): Terminating (SIGTERM) 13:43:26.233695 run iperf3-srv_10.42.42.10(pid=27706): Terminating (SIGTERM) 13:43:26.273053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27707): Terminating (SIGTERM) 13:43:26.312592 run iperf3-srv_10.42.42.10(pid=27708): Terminating (SIGTERM) 13:43:26.351999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27711): Terminating (SIGTERM) 13:43:26.391526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27714): Terminating (SIGTERM) 13:43:26.430883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27717): Terminating (SIGTERM) 13:43:26.470660 --- ParallelTerminationStrategy: PID 27701 died... 13:43:26.489858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27701): Terminated: ok {rc=0} 13:43:26.533336 --- ParallelTerminationStrategy: PID 27702 died... 13:43:26.551821 run iperf3-srv_10.42.42.10(pid=27702): Terminated {rc=256} 13:43:26.594996 --- ParallelTerminationStrategy: PID 27703 died... 13:43:26.613586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27703): Terminated: ok {rc=0} 13:43:26.656809 --- ParallelTerminationStrategy: PID 27704 died... 13:43:26.675765 run iperf3-srv_10.42.42.10(pid=27704): Terminated {rc=256} 13:43:26.719028 --- ParallelTerminationStrategy: PID 27705 died... 13:43:26.737559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27705): Terminated: ok {rc=0} 13:43:26.780866 --- ParallelTerminationStrategy: PID 27706 died... 13:43:26.799990 run iperf3-srv_10.42.42.10(pid=27706): Terminated {rc=256} 13:43:26.843391 --- ParallelTerminationStrategy: PID 27707 died... 13:43:26.862072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27707): Terminated: ok {rc=0} 13:43:26.905485 --- ParallelTerminationStrategy: PID 27708 died... 13:43:26.924084 run iperf3-srv_10.42.42.10(pid=27708): Terminated {rc=256} 13:43:26.967254 --- ParallelTerminationStrategy: PID 27711 died... 13:43:26.986020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27711): Terminated: ok {rc=0} 13:43:27.029514 --- ParallelTerminationStrategy: PID 27714 died... 13:43:27.048157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27714): Terminated: ok {rc=0} 13:43:27.091461 --- ParallelTerminationStrategy: PID 27717 died... 13:43:27.110026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27717): Terminated: ok {rc=0} 13:43:27.195366 bus /gobi_4: Setting Powered False 13:43:28.294434 bus /gobi_4: Setting Powered False 13:43:29.408683 bus /gobi_1: Setting Powered False 13:43:30.505103 bus /gobi_1: Setting Powered False 13:43:31.621542 bus /gobi_0: Setting Powered False 13:43:32.720791 bus /gobi_0: Setting Powered False 13:43:33.833840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:43:34.935109 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.947127 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:35.018875 tst ping.py: using LAC 34337 13:43:35.145844 tst ping.py: using RAC 167 13:43:35.270980 tst ping.py: using CellId 34337 13:43:35.396715 tst ping.py: using BVCI 34338 13:43:35.514227 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.525775 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.536836 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.548070 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.559735 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.571360 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.583034 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:35.594553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:35.713657 tst ping.py:19: start network... 13:43:35.914114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:36.381639 run create_hlr_db(pid=27719): Launched 13:43:36.505795 bus /gobi_6: Setting Powered False 13:43:37.564907 run create_hlr_db(pid=27719): Terminated: ok {rc=0} 13:43:38.000287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27721): Launched 13:43:38.320525 run osmo-hlr_10.42.42.2(pid=27722): Launched 13:43:38.442144 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:39.003135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27724): Launched 13:43:39.322526 run osmo-stp_10.42.42.5(pid=27725): Launched 13:43:39.446169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:39.994983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27727): Launched 13:43:40.116580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:40.385864 run patchelf(pid=27728): Launched 13:43:40.563971 run osmo-stp_10.42.42.5(pid=27725): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27725)] 13:43:40.699289 run osmo-stp_10.42.42.5(pid=27725): stdout: | (launched: 2022-12-13_13:43:39.264077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:40.836071 run osmo-stp_10.42.42.5(pid=27725): stderr: | 20221213134339449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134339450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134339450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134339450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134339451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134339451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134339451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:40.973303 run osmo-stp_10.42.42.5(pid=27725): stdout: | (launched: 2022-12-13_13:43:39.264077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:41.104167 run osmo-stp_10.42.42.5(pid=27725): stderr: | 20221213134339449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134339450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134339450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134339450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134339451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134339451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134339451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:41.259336 run patchelf(pid=27728): Terminating (SIGINT) 13:43:41.438119 run patchelf(pid=27728): Terminated: ok {rc=0} 13:43:41.567133 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27725): Process ended prematurely: osmo-stp_10.42.42.5(pid=27725) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27725)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 13:43:41.576723 tst ping.py:22: Test FAILED (6.6 sec) 13:43:41.604749 run osmo-hlr_10.42.42.2(pid=27722): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27722)] 13:43:41.654589 run osmo-hlr_10.42.42.2(pid=27722): stdout: | (launched: 2022-12-13_13:43:38.261797) 13:43:41.705510 run osmo-hlr_10.42.42.2(pid=27722): stderr: | 20221213134338453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134338453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134338454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134338454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134338454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134338454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134338467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134338477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134338478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134338478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:41.757115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27721): Terminating (SIGTERM) 13:43:41.798480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27724): Terminating (SIGTERM) 13:43:41.839789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27727): Terminating (SIGTERM) 13:43:41.882052 --- ParallelTerminationStrategy: PID 27721 died... 13:43:41.902132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27721): Terminated: ok {rc=0} 13:43:41.948134 --- ParallelTerminationStrategy: PID 27724 died... 13:43:41.967895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27724): Terminated: ok {rc=0} 13:43:42.013546 --- ParallelTerminationStrategy: PID 27727 died... 13:43:42.033356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27727): Terminated: ok {rc=0} 13:43:42.120571 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:43:43.207577 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.219713 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:43.295911 tst ping_idle_ping.py: using LAC 34338 13:43:43.422852 tst ping_idle_ping.py: using RAC 168 13:43:43.547678 tst ping_idle_ping.py: using CellId 34338 13:43:43.674671 tst ping_idle_ping.py: using BVCI 34339 13:43:43.791141 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.802611 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.813857 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.825068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.837029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.848942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.861080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:43.873023 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:43.995088 tst ping_idle_ping.py:24: start network... 13:43:44.210164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:44.702386 run create_hlr_db(pid=27729): Launched 13:43:44.823268 bus /gobi_6: Setting Powered False 13:43:45.898909 run create_hlr_db(pid=27729): Terminated: ok {rc=0} 13:43:46.384766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Launched 13:43:46.749340 run osmo-hlr_10.42.42.2(pid=27732): Launched 13:43:46.902293 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:47.584339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Launched 13:43:47.884329 run osmo-stp_10.42.42.5(pid=27735): Launched 13:43:47.996510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:48.513308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27737): Launched 13:43:48.627958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:48.881521 run patchelf(pid=27738): Launched 13:43:49.048428 run osmo-stp_10.42.42.5(pid=27735): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] 13:43:49.176193 run osmo-stp_10.42.42.5(pid=27735): stdout: | (launched: 2022-12-13_13:43:47.829134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:49.305865 run osmo-stp_10.42.42.5(pid=27735): stderr: | 20221213134347996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134347996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134347996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134347996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134347997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134347997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134347997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:49.435724 run osmo-stp_10.42.42.5(pid=27735): stdout: | (launched: 2022-12-13_13:43:47.829134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:49.559278 run osmo-stp_10.42.42.5(pid=27735): stderr: | 20221213134347996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134347996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134347996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134347996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134347997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134347997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134347997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:49.705820 run patchelf(pid=27738): Terminating (SIGINT) 13:43:49.876262 run patchelf(pid=27738): Terminated: ok {rc=0} 13:43:49.999160 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27735): Process ended prematurely: osmo-stp_10.42.42.5(pid=27735) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:43:50.008054 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:43:50.034280 run osmo-hlr_10.42.42.2(pid=27732): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27732)] 13:43:50.081458 run osmo-hlr_10.42.42.2(pid=27732): stdout: | (launched: 2022-12-13_13:43:46.691189) 13:43:50.129947 run osmo-hlr_10.42.42.2(pid=27732): stderr: | 20221213134347072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134347073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134347073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134347073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134347074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134347074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134347104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134347117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134347117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134347117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:50.178769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Terminating (SIGTERM) 13:43:50.218279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Terminating (SIGTERM) 13:43:50.257553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27737): Terminating (SIGTERM) 13:43:50.297072 --- ParallelTerminationStrategy: PID 27731 died... 13:43:50.315987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Terminated: ok {rc=0} 13:43:50.359372 --- ParallelTerminationStrategy: PID 27734 died... 13:43:50.377938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Terminated: ok {rc=0} 13:43:50.421040 --- ParallelTerminationStrategy: PID 27737 died... 13:43:50.439524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27737): Terminated: ok {rc=0} 13:43:50.523730 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:43:51.826697 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:51.832532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:43:51.864746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:43:51.903502 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:43:51.989820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:43:52.021972 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:43:52.060273 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:43:52.654988 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:43:52.703978 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:52.714899 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:43:52.783907 tst cs_paging_gprs_active.py: using LAC 34339 13:43:52.905524 tst cs_paging_gprs_active.py: using RAC 169 13:43:53.036253 tst cs_paging_gprs_active.py: using CellId 34339 13:43:53.163729 tst cs_paging_gprs_active.py: using BVCI 34340 13:43:53.282998 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.294651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.306075 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.317625 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.329494 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.341578 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.353303 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.364857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:43:53.376737 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:43:53.495746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:43:53.620493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:43:53.842227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:54.171122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27742): Launched 13:43:54.458649 run iperf3-srv_10.42.42.10(pid=27743): Launched 13:43:54.582060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:43:54.802477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:55.131346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27744): Launched 13:43:55.418955 run iperf3-srv_10.42.42.10(pid=27745): Launched 13:43:55.543242 tst cs_paging_gprs_active.py:38: start network... 13:43:55.762975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:56.268612 run create_hlr_db(pid=27746): Launched 13:43:56.394391 bus /gobi_6: Setting Powered False 13:43:57.458745 run create_hlr_db(pid=27746): Terminated: ok {rc=0} 13:43:57.895947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27748): Launched 13:43:58.201638 run osmo-hlr_10.42.42.2(pid=27749): Launched 13:43:58.320419 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:58.847843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27751): Launched 13:43:59.152033 run osmo-stp_10.42.42.5(pid=27752): Launched 13:43:59.268629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:59.794541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27754): Launched 13:43:59.911478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:00.170553 run patchelf(pid=27755): Launched 13:44:00.340750 run osmo-stp_10.42.42.5(pid=27752): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27752)] 13:44:00.469332 run osmo-stp_10.42.42.5(pid=27752): stdout: | (launched: 2022-12-13_13:43:59.095713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:00.599540 run osmo-stp_10.42.42.5(pid=27752): stderr: | 20221213134359262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134359262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134359263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134359263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134359263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134359264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134359264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:00.729528 run osmo-stp_10.42.42.5(pid=27752): stdout: | (launched: 2022-12-13_13:43:59.095713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:00.858967 run osmo-stp_10.42.42.5(pid=27752): stderr: | 20221213134359262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134359262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134359263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134359263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134359263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134359264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134359264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:01.029478 run patchelf(pid=27755): Terminating (SIGINT) 13:44:01.205897 run patchelf(pid=27755): Terminated: ok {rc=0} 13:44:01.334033 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27752): Process ended prematurely: osmo-stp_10.42.42.5(pid=27752) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27752)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:44:01.344431 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:44:01.372709 run osmo-hlr_10.42.42.2(pid=27749): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27749)] 13:44:01.421280 run osmo-hlr_10.42.42.2(pid=27749): stdout: | (launched: 2022-12-13_13:43:58.145662) 13:44:01.471808 run osmo-hlr_10.42.42.2(pid=27749): stderr: | 20221213134358320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134358320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134358320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134358320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134358320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134358320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134358333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134358342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134358343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134358343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:01.522489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27742): Terminating (SIGTERM) 13:44:01.563649 run iperf3-srv_10.42.42.10(pid=27743): Terminating (SIGTERM) 13:44:01.607597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27744): Terminating (SIGTERM) 13:44:01.649282 run iperf3-srv_10.42.42.10(pid=27745): Terminating (SIGTERM) 13:44:01.693135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27748): Terminating (SIGTERM) 13:44:01.734140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27751): Terminating (SIGTERM) 13:44:01.774023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27754): Terminating (SIGTERM) 13:44:01.814058 --- ParallelTerminationStrategy: PID 27742 died... 13:44:01.832900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27742): Terminated: ok {rc=0} 13:44:01.877144 --- ParallelTerminationStrategy: PID 27743 died... 13:44:01.896187 run iperf3-srv_10.42.42.10(pid=27743): Terminated {rc=256} 13:44:01.940258 --- ParallelTerminationStrategy: PID 27744 died... 13:44:01.959844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27744): Terminated: ok {rc=0} 13:44:02.003967 --- ParallelTerminationStrategy: PID 27745 died... 13:44:02.023259 run iperf3-srv_10.42.42.10(pid=27745): Terminated {rc=256} 13:44:02.067311 --- ParallelTerminationStrategy: PID 27748 died... 13:44:02.086154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27748): Terminated: ok {rc=0} 13:44:02.130151 --- ParallelTerminationStrategy: PID 27751 died... 13:44:02.148881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27751): Terminated: ok {rc=0} 13:44:02.192569 --- ParallelTerminationStrategy: PID 27754 died... 13:44:02.211355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27754): Terminated: ok {rc=0} 13:44:02.296322 bus /gobi_0: Setting Powered False 13:44:03.396318 bus /gobi_0: Setting Powered False 13:44:04.512699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:44:05.659947 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:05.671606 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:05.741781 tst iperf3.py: using LAC 34340 13:44:05.862193 tst iperf3.py: using RAC 170 13:44:05.982233 tst iperf3.py: using CellId 34340 13:44:06.105077 tst iperf3.py: using BVCI 34341 13:44:06.217109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.228098 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.238838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.249566 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.260109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.271277 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.282496 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.293208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:06.304002 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:06.420551 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:06.625680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:06.931959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27756): Launched 13:44:07.197752 run iperf3-srv_10.42.42.10(pid=27757): Launched 13:44:07.313582 tst iperf3.py:8: start network... 13:44:07.519252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:07.993266 run create_hlr_db(pid=27758): Launched 13:44:08.118124 bus /gobi_6: Setting Powered False 13:44:09.178200 run create_hlr_db(pid=27758): Terminated: ok {rc=0} 13:44:09.621294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27760): Launched 13:44:09.946591 run osmo-hlr_10.42.42.2(pid=27761): Launched 13:44:10.069639 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:10.629885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27763): Launched 13:44:10.954653 run osmo-stp_10.42.42.5(pid=27764): Launched 13:44:11.078726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:11.639840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27766): Launched 13:44:11.764186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:12.038583 run patchelf(pid=27767): Launched 13:44:12.219863 run osmo-stp_10.42.42.5(pid=27764): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27764)] 13:44:12.357226 run osmo-stp_10.42.42.5(pid=27764): stdout: | (launched: 2022-12-13_13:44:10.894525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:12.496143 run osmo-stp_10.42.42.5(pid=27764): stderr: | 20221213134411083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134411083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134411083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134411084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134411084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134411084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134411085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:12.635204 run osmo-stp_10.42.42.5(pid=27764): stdout: | (launched: 2022-12-13_13:44:10.894525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:12.767889 run osmo-stp_10.42.42.5(pid=27764): stderr: | 20221213134411083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134411083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134411083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134411084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134411084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134411084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134411085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:12.925661 run patchelf(pid=27767): Terminating (SIGINT) 13:44:13.108295 run patchelf(pid=27767): Terminated: ok {rc=0} 13:44:13.239979 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27764): Process ended prematurely: osmo-stp_10.42.42.5(pid=27764) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27764)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 13:44:13.250377 tst iperf3.py:8: Test FAILED (7.6 sec) 13:44:13.278554 run osmo-hlr_10.42.42.2(pid=27761): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27761)] 13:44:13.328616 run osmo-hlr_10.42.42.2(pid=27761): stdout: | (launched: 2022-12-13_13:44:09.886846) 13:44:13.380624 run osmo-hlr_10.42.42.2(pid=27761): stderr: | 20221213134410083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134410083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134410083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134410083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134410083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134410083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134410095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134410104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134410104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134410104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:13.432567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27756): Terminating (SIGTERM) 13:44:13.474532 run iperf3-srv_10.42.42.10(pid=27757): Terminating (SIGTERM) 13:44:13.516852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27760): Terminating (SIGTERM) 13:44:13.559440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27763): Terminating (SIGTERM) 13:44:13.602061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27766): Terminating (SIGTERM) 13:44:13.644793 --- ParallelTerminationStrategy: PID 27756 died... 13:44:13.664937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27756): Terminated: ok {rc=0} 13:44:13.711163 --- ParallelTerminationStrategy: PID 27757 died... 13:44:13.730830 run iperf3-srv_10.42.42.10(pid=27757): Terminated {rc=256} 13:44:13.776929 --- ParallelTerminationStrategy: PID 27760 died... 13:44:13.797077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27760): Terminated: ok {rc=0} 13:44:13.843182 --- ParallelTerminationStrategy: PID 27763 died... 13:44:13.862925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27763): Terminated: ok {rc=0} 13:44:13.909099 --- ParallelTerminationStrategy: PID 27766 died... 13:44:13.928818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27766): Terminated: ok {rc=0} 13:44:14.016692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:44:15.166964 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.179243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:15.251332 tst iperf3m4.py: using LAC 34341 13:44:15.380919 tst iperf3m4.py: using RAC 171 13:44:15.509169 tst iperf3m4.py: using CellId 34341 13:44:15.637753 tst iperf3m4.py: using BVCI 34342 13:44:15.756652 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.768296 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.779814 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.791350 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.803066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.814893 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.827929 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.852260 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:15.876577 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:16.021473 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:16.150325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:16.270145 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:16.396395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:16.621441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:16.954752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27768): Launched 13:44:17.252094 run iperf3-srv_10.42.42.10(pid=27769): Launched 13:44:17.374945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:44:17.594233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:17.919439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27770): Launched 13:44:18.203587 run iperf3-srv_10.42.42.10(pid=27771): Launched 13:44:18.326256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:44:18.546524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:18.872173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Launched 13:44:19.155289 run iperf3-srv_10.42.42.10(pid=27773): Launched 13:44:19.277534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:44:19.496614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:19.822965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Launched 13:44:20.106439 run iperf3-srv_10.42.42.10(pid=27775): Launched 13:44:20.230097 tst iperf3m4.py:8: start network... 13:44:20.449169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:20.953105 run create_hlr_db(pid=27776): Launched 13:44:21.079280 bus /gobi_6: Setting Powered False 13:44:22.142618 run create_hlr_db(pid=27776): Terminated: ok {rc=0} 13:44:22.594546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27778): Launched 13:44:22.921278 run osmo-hlr_10.42.42.2(pid=27779): Launched 13:44:23.047276 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:23.604160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27781): Launched 13:44:23.928282 run osmo-stp_10.42.42.5(pid=27782): Launched 13:44:24.051854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:24.612607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27784): Launched 13:44:24.738597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:25.012506 run patchelf(pid=27785): Launched 13:44:25.193878 run osmo-stp_10.42.42.5(pid=27782): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27782)] 13:44:25.331193 run osmo-stp_10.42.42.5(pid=27782): stdout: | (launched: 2022-12-13_13:44:23.868591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:25.471012 run osmo-stp_10.42.42.5(pid=27782): stderr: | 20221213134424054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134424055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134424055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134424055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134424056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134424056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134424056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:25.610186 run osmo-stp_10.42.42.5(pid=27782): stdout: | (launched: 2022-12-13_13:44:23.868591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:25.743309 run osmo-stp_10.42.42.5(pid=27782): stderr: | 20221213134424054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134424055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134424055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134424055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134424056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134424056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134424056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:25.900575 run patchelf(pid=27785): Terminating (SIGINT) 13:44:26.083169 run patchelf(pid=27785): Terminated: ok {rc=0} 13:44:26.214915 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27782): Process ended prematurely: osmo-stp_10.42.42.5(pid=27782) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27782)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:44:26.225181 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:44:26.253702 run osmo-hlr_10.42.42.2(pid=27779): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27779)] 13:44:26.304190 run osmo-hlr_10.42.42.2(pid=27779): stdout: | (launched: 2022-12-13_13:44:22.861476) 13:44:26.356198 run osmo-hlr_10.42.42.2(pid=27779): stderr: | 20221213134423055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134423055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134423055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134423055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134423055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134423055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134423067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134423077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134423077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134423077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:26.408376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27768): Terminating (SIGTERM) 13:44:26.450296 run iperf3-srv_10.42.42.10(pid=27769): Terminating (SIGTERM) 13:44:26.492508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27770): Terminating (SIGTERM) 13:44:26.534482 run iperf3-srv_10.42.42.10(pid=27771): Terminating (SIGTERM) 13:44:26.576912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Terminating (SIGTERM) 13:44:26.619163 run iperf3-srv_10.42.42.10(pid=27773): Terminating (SIGTERM) 13:44:26.661281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Terminating (SIGTERM) 13:44:26.703129 run iperf3-srv_10.42.42.10(pid=27775): Terminating (SIGTERM) 13:44:26.744628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27778): Terminating (SIGTERM) 13:44:26.786719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27781): Terminating (SIGTERM) 13:44:26.828915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27784): Terminating (SIGTERM) 13:44:26.871374 --- ParallelTerminationStrategy: PID 27768 died... 13:44:26.891501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27768): Terminated: ok {rc=0} 13:44:26.937468 --- ParallelTerminationStrategy: PID 27769 died... 13:44:26.956874 run iperf3-srv_10.42.42.10(pid=27769): Terminated {rc=256} 13:44:27.002442 --- ParallelTerminationStrategy: PID 27770 died... 13:44:27.021979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27770): Terminated: ok {rc=0} 13:44:27.067767 --- ParallelTerminationStrategy: PID 27771 died... 13:44:27.087298 run iperf3-srv_10.42.42.10(pid=27771): Terminated {rc=256} 13:44:27.133187 --- ParallelTerminationStrategy: PID 27772 died... 13:44:27.152697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Terminated: ok {rc=0} 13:44:27.198352 --- ParallelTerminationStrategy: PID 27773 died... 13:44:27.217884 run iperf3-srv_10.42.42.10(pid=27773): Terminated {rc=256} 13:44:27.263582 --- ParallelTerminationStrategy: PID 27774 died... 13:44:27.283149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Terminated: ok {rc=0} 13:44:27.328730 --- ParallelTerminationStrategy: PID 27775 died... 13:44:27.348303 run iperf3-srv_10.42.42.10(pid=27775): Terminated {rc=256} 13:44:27.393978 --- ParallelTerminationStrategy: PID 27778 died... 13:44:27.413594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27778): Terminated: ok {rc=0} 13:44:27.459073 --- ParallelTerminationStrategy: PID 27781 died... 13:44:27.478623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27781): Terminated: ok {rc=0} 13:44:27.524185 --- ParallelTerminationStrategy: PID 27784 died... 13:44:27.543736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27784): Terminated: ok {rc=0} 13:44:27.631219 bus /gobi_4: Setting Powered False 13:44:28.730139 bus /gobi_4: Setting Powered False 13:44:29.845508 bus /gobi_1: Setting Powered False 13:44:30.944449 bus /gobi_1: Setting Powered False 13:44:32.074041 bus /gobi_0: Setting Powered False 13:44:33.190481 bus /gobi_0: Setting Powered False 13:44:34.307818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:44:35.410683 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:35.422482 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:35.493629 tst ping.py: using LAC 34342 13:44:35.611367 tst ping.py: using RAC 172 13:44:35.729947 tst ping.py: using CellId 34342 13:44:35.856394 tst ping.py: using BVCI 34343 13:44:35.972694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:35.984335 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:35.995813 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:36.007281 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:36.019002 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:36.030740 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:36.042376 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:36.053957 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:36.170807 tst ping.py:19: start network... 13:44:36.370919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:36.837350 run create_hlr_db(pid=27787): Launched 13:44:36.962445 bus /gobi_6: Setting Powered False 13:44:38.022165 run create_hlr_db(pid=27787): Terminated: ok {rc=0} 13:44:38.440596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Launched 13:44:38.740631 run osmo-hlr_10.42.42.2(pid=27790): Launched 13:44:38.853093 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:39.381981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Launched 13:44:39.679893 run osmo-stp_10.42.42.5(pid=27793): Launched 13:44:39.791663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:40.313422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27795): Launched 13:44:40.426616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:40.678373 run patchelf(pid=27796): Launched 13:44:40.842464 run osmo-stp_10.42.42.5(pid=27793): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] 13:44:40.968222 run osmo-stp_10.42.42.5(pid=27793): stdout: | (launched: 2022-12-13_13:44:39.624125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:41.095364 run osmo-stp_10.42.42.5(pid=27793): stderr: | 20221213134439792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134439792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134439792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134439793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134439793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134439793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134439793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:41.222843 run osmo-stp_10.42.42.5(pid=27793): stdout: | (launched: 2022-12-13_13:44:39.624125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:41.343844 run osmo-stp_10.42.42.5(pid=27793): stderr: | 20221213134439792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134439792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134439792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134439793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134439793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134439793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134439793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:41.487379 run patchelf(pid=27796): Terminating (SIGINT) 13:44:41.654027 run patchelf(pid=27796): Terminated: ok {rc=0} 13:44:41.774216 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27793): Process ended prematurely: osmo-stp_10.42.42.5(pid=27793) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 13:44:41.783099 tst ping.py:22: Test FAILED (6.4 sec) 13:44:41.809669 run osmo-hlr_10.42.42.2(pid=27790): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27790)] 13:44:41.857341 run osmo-hlr_10.42.42.2(pid=27790): stdout: | (launched: 2022-12-13_13:44:38.685340) 13:44:41.906285 run osmo-hlr_10.42.42.2(pid=27790): stderr: | 20221213134438857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134438857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134438857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134438857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134438857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134438858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134438869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134438881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134438882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134438882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:41.955671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Terminating (SIGTERM) 13:44:41.995338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Terminating (SIGTERM) 13:44:42.035071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27795): Terminating (SIGTERM) 13:44:42.075027 --- ParallelTerminationStrategy: PID 27789 died... 13:44:42.094313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27789): Terminated: ok {rc=0} 13:44:42.138046 --- ParallelTerminationStrategy: PID 27792 died... 13:44:42.156683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27792): Terminated: ok {rc=0} 13:44:42.200288 --- ParallelTerminationStrategy: PID 27795 died... 13:44:42.218886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27795): Terminated: ok {rc=0} 13:44:42.304237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:44:43.392295 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:43.403910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:43.480443 tst ping_idle_ping.py: using LAC 34343 13:44:43.595438 tst ping_idle_ping.py: using RAC 173 13:44:43.711598 tst ping_idle_ping.py: using CellId 34343 13:44:43.827548 tst ping_idle_ping.py: using BVCI 34344 13:44:43.945447 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:43.956903 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:43.968383 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:43.979821 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:43.991589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:44.003462 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:44.015295 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:44.026979 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:44.143774 tst ping_idle_ping.py:24: start network... 13:44:44.342641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:44.802662 run create_hlr_db(pid=27797): Launched 13:44:44.925663 bus /gobi_6: Setting Powered False 13:44:45.984547 run create_hlr_db(pid=27797): Terminated: ok {rc=0} 13:44:46.409888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27799): Launched 13:44:46.793488 run osmo-hlr_10.42.42.2(pid=27800): Launched 13:44:47.049522 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:47.725720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27802): Launched 13:44:48.044865 run osmo-stp_10.42.42.5(pid=27803): Launched 13:44:48.166454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:48.714814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27805): Launched 13:44:48.838069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:49.106473 run patchelf(pid=27806): Launched 13:44:49.283477 run osmo-stp_10.42.42.5(pid=27803): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27803)] 13:44:49.419102 run osmo-stp_10.42.42.5(pid=27803): stdout: | (launched: 2022-12-13_13:44:47.986018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:49.556272 run osmo-stp_10.42.42.5(pid=27803): stderr: | 20221213134448173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134448173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134448173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134448174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134448174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134448174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134448174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:49.693189 run osmo-stp_10.42.42.5(pid=27803): stdout: | (launched: 2022-12-13_13:44:47.986018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:49.823340 run osmo-stp_10.42.42.5(pid=27803): stderr: | 20221213134448173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134448173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134448173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134448174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134448174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134448174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134448174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:49.977830 run patchelf(pid=27806): Terminating (SIGINT) 13:44:50.156900 run patchelf(pid=27806): Terminated: ok {rc=0} 13:44:50.286115 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27803): Process ended prematurely: osmo-stp_10.42.42.5(pid=27803) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27803)] [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:44:50.295919 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 13:44:50.324119 run osmo-hlr_10.42.42.2(pid=27800): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27800)] 13:44:50.374987 run osmo-hlr_10.42.42.2(pid=27800): stdout: | (launched: 2022-12-13_13:44:46.734327) 13:44:50.426788 run osmo-hlr_10.42.42.2(pid=27800): stderr: | 20221213134446977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134446977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134446977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134446977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134446977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134446977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134447006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134447023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134447023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134447023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:50.478923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27799): Terminating (SIGTERM) 13:44:50.520437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27802): Terminating (SIGTERM) 13:44:50.562345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27805): Terminating (SIGTERM) 13:44:50.604543 --- ParallelTerminationStrategy: PID 27799 died... 13:44:50.625095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27799): Terminated: ok {rc=0} 13:44:50.671349 --- ParallelTerminationStrategy: PID 27802 died... 13:44:50.691741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27802): Terminated: ok {rc=0} 13:44:50.737997 --- ParallelTerminationStrategy: PID 27805 died... 13:44:50.757932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27805): Terminated: ok {rc=0} 13:44:50.846207 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:44:52.164012 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:52.172633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:44:52.206865 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:44:52.246935 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:44:52.346232 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:44:52.380362 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:44:52.420384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:44:53.020154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:44:53.072841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.084837 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:44:53.140026 tst cs_paging_gprs_active.py: using LAC 34344 13:44:53.268789 tst cs_paging_gprs_active.py: using RAC 174 13:44:53.401955 tst cs_paging_gprs_active.py: using CellId 34344 13:44:53.529090 tst cs_paging_gprs_active.py: using BVCI 34345 13:44:53.647331 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.659245 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.671028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.683077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.695278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.707258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.719346 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.731267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:44:53.743565 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:44:53.861294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:44:53.977969 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:44:54.180902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:54.485726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27811): Launched 13:44:54.750342 run iperf3-srv_10.42.42.10(pid=27812): Launched 13:44:54.866256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:44:55.068645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:55.372842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Launched 13:44:55.636160 run iperf3-srv_10.42.42.10(pid=27814): Launched 13:44:55.749462 tst cs_paging_gprs_active.py:38: start network... 13:44:55.950930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:56.420269 run create_hlr_db(pid=27815): Launched 13:44:56.545990 bus /gobi_6: Setting Powered False 13:44:57.606109 run create_hlr_db(pid=27815): Terminated: ok {rc=0} 13:44:58.047579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Launched 13:44:58.372612 run osmo-hlr_10.42.42.2(pid=27818): Launched 13:44:58.497054 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:59.056745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Launched 13:44:59.382017 run osmo-stp_10.42.42.5(pid=27821): Launched 13:44:59.508497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:00.067277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Launched 13:45:00.191335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:00.465505 run patchelf(pid=27824): Launched 13:45:00.645526 run osmo-stp_10.42.42.5(pid=27821): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] 13:45:00.782716 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-13_13:44:59.322351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:00.939556 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221213134459508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134459508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134459509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134459509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134459510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134459510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134459510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:01.120320 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-13_13:44:59.322351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:01.278044 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221213134459508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134459508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134459509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134459509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134459510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134459510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134459510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:01.439903 run patchelf(pid=27824): Terminating (SIGINT) 13:45:01.625263 run patchelf(pid=27824): Terminated: ok {rc=0} 13:45:01.759875 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:45:01.771337 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:45:01.802049 run osmo-hlr_10.42.42.2(pid=27818): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27818)] 13:45:01.855837 run osmo-hlr_10.42.42.2(pid=27818): stdout: | (launched: 2022-12-13_13:44:58.312816) 13:45:01.910668 run osmo-hlr_10.42.42.2(pid=27818): stderr: | 20221213134458508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134458508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134458508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134458508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134458508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134458508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134458520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134458528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134458529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134458529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:01.971238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27811): Terminating (SIGTERM) 13:45:02.025762 run iperf3-srv_10.42.42.10(pid=27812): Terminating (SIGTERM) 13:45:02.077615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Terminating (SIGTERM) 13:45:02.121303 run iperf3-srv_10.42.42.10(pid=27814): Terminating (SIGTERM) 13:45:02.168514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminating (SIGTERM) 13:45:02.213779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminating (SIGTERM) 13:45:02.255730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Terminating (SIGTERM) 13:45:02.297969 --- ParallelTerminationStrategy: PID 27811 died... 13:45:02.317859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27811): Terminated: ok {rc=0} 13:45:02.364356 --- ParallelTerminationStrategy: PID 27812 died... 13:45:02.384429 run iperf3-srv_10.42.42.10(pid=27812): Terminated {rc=256} 13:45:02.430694 --- ParallelTerminationStrategy: PID 27813 died... 13:45:02.450497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Terminated: ok {rc=0} 13:45:02.496502 --- ParallelTerminationStrategy: PID 27814 died... 13:45:02.516220 run iperf3-srv_10.42.42.10(pid=27814): Terminated {rc=256} 13:45:02.562330 --- ParallelTerminationStrategy: PID 27817 died... 13:45:02.582186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminated: ok {rc=0} 13:45:02.628338 --- ParallelTerminationStrategy: PID 27820 died... 13:45:02.648189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminated: ok {rc=0} 13:45:02.694763 --- ParallelTerminationStrategy: PID 27823 died... 13:45:02.714520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27823): Terminated: ok {rc=0} 13:45:02.802811 bus /gobi_0: Setting Powered False 13:45:03.900266 bus /gobi_0: Setting Powered False 13:45:05.015092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:45:06.162928 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.175202 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:45:06.232458 tst iperf3.py: using LAC 34345 13:45:06.361272 tst iperf3.py: using RAC 175 13:45:06.486365 tst iperf3.py: using CellId 34345 13:45:06.604786 tst iperf3.py: using BVCI 34346 13:45:06.715625 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.727172 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.738520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.749873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.761121 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.772323 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.783637 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.794840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:06.806223 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:06.921148 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:07.123417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:07.428458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27828): Launched 13:45:07.691929 run iperf3-srv_10.42.42.10(pid=27829): Launched 13:45:07.805917 tst iperf3.py:8: start network... 13:45:08.007675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:08.475302 run create_hlr_db(pid=27830): Launched 13:45:08.598966 bus /gobi_6: Setting Powered False 13:45:09.658032 run create_hlr_db(pid=27830): Terminated: ok {rc=0} 13:45:10.097264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Launched 13:45:10.419900 run osmo-hlr_10.42.42.2(pid=27833): Launched 13:45:10.542381 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:11.100899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Launched 13:45:11.423362 run osmo-stp_10.42.42.5(pid=27836): Launched 13:45:11.547432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:12.104080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27838): Launched 13:45:12.227339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:12.501195 run patchelf(pid=27839): Launched 13:45:12.680269 run osmo-stp_10.42.42.5(pid=27836): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] 13:45:12.816923 run osmo-stp_10.42.42.5(pid=27836): stdout: | (launched: 2022-12-13_13:45:11.364026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:12.955817 run osmo-stp_10.42.42.5(pid=27836): stderr: | 20221213134511553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134511553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134511553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134511554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134511554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134511554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134511555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:13.094752 run osmo-stp_10.42.42.5(pid=27836): stdout: | (launched: 2022-12-13_13:45:11.364026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:13.227086 run osmo-stp_10.42.42.5(pid=27836): stderr: | 20221213134511553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134511553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134511553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134511554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134511554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134511554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134511555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:13.384153 run patchelf(pid=27839): Terminating (SIGINT) 13:45:13.567143 run patchelf(pid=27839): Terminated: ok {rc=0} 13:45:13.698686 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27836): Process ended prematurely: osmo-stp_10.42.42.5(pid=27836) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:45:13.708894 tst iperf3.py:8: Test FAILED (7.6 sec) 13:45:13.737444 run osmo-hlr_10.42.42.2(pid=27833): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27833)] 13:45:13.787729 run osmo-hlr_10.42.42.2(pid=27833): stdout: | (launched: 2022-12-13_13:45:10.360633) 13:45:13.839477 run osmo-hlr_10.42.42.2(pid=27833): stderr: | 20221213134510556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134510556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134510556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134510556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134510556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134510556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134510569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134510577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134510577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134510577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:13.891608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27828): Terminating (SIGTERM) 13:45:13.933132 run iperf3-srv_10.42.42.10(pid=27829): Terminating (SIGTERM) 13:45:13.974882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Terminating (SIGTERM) 13:45:14.016726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Terminating (SIGTERM) 13:45:14.058799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27838): Terminating (SIGTERM) 13:45:14.101009 --- ParallelTerminationStrategy: PID 27828 died... 13:45:14.121296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27828): Terminated: ok {rc=0} 13:45:14.167306 --- ParallelTerminationStrategy: PID 27829 died... 13:45:14.186945 run iperf3-srv_10.42.42.10(pid=27829): Terminated {rc=256} 13:45:14.232689 --- ParallelTerminationStrategy: PID 27832 died... 13:45:14.252412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Terminated: ok {rc=0} 13:45:14.298163 --- ParallelTerminationStrategy: PID 27835 died... 13:45:14.317901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Terminated: ok {rc=0} 13:45:14.363845 --- ParallelTerminationStrategy: PID 27838 died... 13:45:14.383911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27838): Terminated: ok {rc=0} 13:45:14.471602 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:45:15.622316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:15.634779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:45:15.689505 tst iperf3m4.py: using LAC 34346 13:45:15.808861 tst iperf3m4.py: using RAC 176 13:45:15.965270 tst iperf3m4.py: using CellId 34346 13:45:16.123957 tst iperf3m4.py: using BVCI 34347 13:45:16.245662 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.258557 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.271349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.284351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.298085 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.311334 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.325423 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.339261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:16.354572 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:16.482131 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:16.610514 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:16.736454 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:16.862288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:17.069215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:17.378536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Launched 13:45:17.642881 run iperf3-srv_10.42.42.10(pid=27841): Launched 13:45:17.755616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:45:17.955958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:18.258157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27842): Launched 13:45:18.521034 run iperf3-srv_10.42.42.10(pid=27843): Launched 13:45:18.633741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:45:18.833765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:19.135270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27844): Launched 13:45:19.397062 run iperf3-srv_10.42.42.10(pid=27845): Launched 13:45:19.510208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:45:19.710561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:20.012273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27846): Launched 13:45:20.275630 run iperf3-srv_10.42.42.10(pid=27847): Launched 13:45:20.388348 tst iperf3m4.py:8: start network... 13:45:20.589245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:21.055599 run create_hlr_db(pid=27848): Launched 13:45:21.179526 bus /gobi_6: Setting Powered False 13:45:22.239423 run create_hlr_db(pid=27848): Terminated: ok {rc=0} 13:45:22.680308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27850): Launched 13:45:23.005163 run osmo-hlr_10.42.42.2(pid=27851): Launched 13:45:23.128240 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:23.689129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27853): Launched 13:45:24.012483 run osmo-stp_10.42.42.5(pid=27854): Launched 13:45:24.135314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:24.692041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27856): Launched 13:45:24.815762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:25.089126 run patchelf(pid=27857): Launched 13:45:25.269866 run osmo-stp_10.42.42.5(pid=27854): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27854)] 13:45:25.407201 run osmo-stp_10.42.42.5(pid=27854): stdout: | (launched: 2022-12-13_13:45:23.953218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:25.545534 run osmo-stp_10.42.42.5(pid=27854): stderr: | 20221213134524142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134524142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134524143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134524143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134524144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134524144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134524144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:25.683678 run osmo-stp_10.42.42.5(pid=27854): stdout: | (launched: 2022-12-13_13:45:23.953218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:25.815807 run osmo-stp_10.42.42.5(pid=27854): stderr: | 20221213134524142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134524142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134524143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134524143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134524144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134524144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134524144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:25.972605 run patchelf(pid=27857): Terminating (SIGINT) 13:45:26.154090 run patchelf(pid=27857): Terminated: ok {rc=0} 13:45:26.284602 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27854): Process ended prematurely: osmo-stp_10.42.42.5(pid=27854) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27854)] [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:45:26.294901 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:45:26.323551 run osmo-hlr_10.42.42.2(pid=27851): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27851)] 13:45:26.373710 run osmo-hlr_10.42.42.2(pid=27851): stdout: | (launched: 2022-12-13_13:45:22.945378) 13:45:26.426042 run osmo-hlr_10.42.42.2(pid=27851): stderr: | 20221213134523140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134523140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134523140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134523140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134523140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134523141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134523153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134523162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134523162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134523162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:26.478015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Terminating (SIGTERM) 13:45:26.519583 run iperf3-srv_10.42.42.10(pid=27841): Terminating (SIGTERM) 13:45:26.561770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27842): Terminating (SIGTERM) 13:45:26.603815 run iperf3-srv_10.42.42.10(pid=27843): Terminating (SIGTERM) 13:45:26.645802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27844): Terminating (SIGTERM) 13:45:26.687805 run iperf3-srv_10.42.42.10(pid=27845): Terminating (SIGTERM) 13:45:26.729692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27846): Terminating (SIGTERM) 13:45:26.771567 run iperf3-srv_10.42.42.10(pid=27847): Terminating (SIGTERM) 13:45:26.814534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27850): Terminating (SIGTERM) 13:45:26.856785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27853): Terminating (SIGTERM) 13:45:26.898662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27856): Terminating (SIGTERM) 13:45:26.940730 --- ParallelTerminationStrategy: PID 27840 died... 13:45:26.961195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27840): Terminated: ok {rc=0} 13:45:27.007575 --- ParallelTerminationStrategy: PID 27841 died... 13:45:27.027505 run iperf3-srv_10.42.42.10(pid=27841): Terminated {rc=256} 13:45:27.073682 --- ParallelTerminationStrategy: PID 27842 died... 13:45:27.093977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27842): Terminated: ok {rc=0} 13:45:27.140139 --- ParallelTerminationStrategy: PID 27843 died... 13:45:27.160001 run iperf3-srv_10.42.42.10(pid=27843): Terminated {rc=256} 13:45:27.205792 --- ParallelTerminationStrategy: PID 27844 died... 13:45:27.225705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27844): Terminated: ok {rc=0} 13:45:27.271614 --- ParallelTerminationStrategy: PID 27845 died... 13:45:27.291394 run iperf3-srv_10.42.42.10(pid=27845): Terminated {rc=256} 13:45:27.337292 --- ParallelTerminationStrategy: PID 27846 died... 13:45:27.357413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27846): Terminated: ok {rc=0} 13:45:27.403755 --- ParallelTerminationStrategy: PID 27847 died... 13:45:27.423601 run iperf3-srv_10.42.42.10(pid=27847): Terminated {rc=256} 13:45:27.469705 --- ParallelTerminationStrategy: PID 27850 died... 13:45:27.489768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27850): Terminated: ok {rc=0} 13:45:27.535980 --- ParallelTerminationStrategy: PID 27853 died... 13:45:27.555968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27853): Terminated: ok {rc=0} 13:45:27.602058 --- ParallelTerminationStrategy: PID 27856 died... 13:45:27.622108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27856): Terminated: ok {rc=0} 13:45:27.710379 bus /gobi_4: Setting Powered False 13:45:28.808412 bus /gobi_4: Setting Powered False 13:45:29.924190 bus /gobi_1: Setting Powered False 13:45:31.027320 bus /gobi_1: Setting Powered False 13:45:32.142791 bus /gobi_0: Setting Powered False 13:45:33.237640 bus /gobi_0: Setting Powered False 13:45:34.349759 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:45:35.449805 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:35.461712 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:45:35.514580 tst ping.py: using LAC 34347 13:45:35.633380 tst ping.py: using RAC 177 13:45:35.751536 tst ping.py: using CellId 34347 13:45:35.869735 tst ping.py: using BVCI 34348 13:45:35.976112 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:35.987515 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:35.998607 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:36.009716 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:36.020733 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:36.031813 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:36.042952 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:36.054031 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:36.173533 tst ping.py:19: start network... 13:45:36.386322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:36.874497 run create_hlr_db(pid=27858): Launched 13:45:36.997353 bus /gobi_6: Setting Powered False 13:45:38.059914 run create_hlr_db(pid=27858): Terminated: ok {rc=0} 13:45:38.483201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27860): Launched 13:45:38.778210 run osmo-hlr_10.42.42.2(pid=27861): Launched 13:45:38.889748 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:39.399926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27863): Launched 13:45:39.695034 run osmo-stp_10.42.42.5(pid=27864): Launched 13:45:39.806039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:40.316680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27866): Launched 13:45:40.429851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:40.679999 run patchelf(pid=27867): Launched 13:45:40.846302 run osmo-stp_10.42.42.5(pid=27864): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27864)] 13:45:40.971573 run osmo-stp_10.42.42.5(pid=27864): stdout: | (launched: 2022-12-13_13:45:39.640062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:41.098931 run osmo-stp_10.42.42.5(pid=27864): stderr: | 20221213134539805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134539806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134539806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134539806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134539807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134539807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134539807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:41.226729 run osmo-stp_10.42.42.5(pid=27864): stdout: | (launched: 2022-12-13_13:45:39.640062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:41.347709 run osmo-stp_10.42.42.5(pid=27864): stderr: | 20221213134539805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134539806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134539806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134539806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134539807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134539807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134539807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:41.491362 run patchelf(pid=27867): Terminating (SIGINT) 13:45:41.658074 run patchelf(pid=27867): Terminated: ok {rc=0} 13:45:41.778000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27864): Process ended prematurely: osmo-stp_10.42.42.5(pid=27864) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27864)] [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:45:41.786970 tst ping.py:22: Test FAILED (6.3 sec) 13:45:41.813332 run osmo-hlr_10.42.42.2(pid=27861): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27861)] 13:45:41.860141 run osmo-hlr_10.42.42.2(pid=27861): stdout: | (launched: 2022-12-13_13:45:38.723772) 13:45:41.908722 run osmo-hlr_10.42.42.2(pid=27861): stderr: | 20221213134538895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134538895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134538895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134538895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134538895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134538895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134538910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134538920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134538921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134538921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:41.957797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27860): Terminating (SIGTERM) 13:45:41.997042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27863): Terminating (SIGTERM) 13:45:42.036226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27866): Terminating (SIGTERM) 13:45:42.075579 --- ParallelTerminationStrategy: PID 27860 died... 13:45:42.094518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27860): Terminated: ok {rc=0} 13:45:42.137945 --- ParallelTerminationStrategy: PID 27863 died... 13:45:42.156227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27863): Terminated: ok {rc=0} 13:45:42.199744 --- ParallelTerminationStrategy: PID 27866 died... 13:45:42.218312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27866): Terminated: ok {rc=0} 13:45:42.300990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:45:43.384486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:43.396314 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:45:43.449178 tst ping_idle_ping.py: using LAC 34348 13:45:43.576136 tst ping_idle_ping.py: using RAC 178 13:45:43.699980 tst ping_idle_ping.py: using CellId 34348 13:45:43.823416 tst ping_idle_ping.py: using BVCI 34349 13:45:43.940226 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:43.952302 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:43.963892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:43.975708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:43.987952 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:44.000013 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:44.012150 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:45:44.024208 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:45:44.141296 tst ping_idle_ping.py:24: start network... 13:45:44.340690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:44.803186 run create_hlr_db(pid=27868): Launched 13:45:44.926711 bus /gobi_6: Setting Powered False 13:45:46.006545 run create_hlr_db(pid=27868): Terminated: ok {rc=0} 13:45:46.466676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27870): Launched 13:45:46.804090 run osmo-hlr_10.42.42.2(pid=27871): Launched 13:45:47.040425 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:47.617563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27873): Launched 13:45:47.915859 run osmo-stp_10.42.42.5(pid=27874): Launched 13:45:48.027263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:48.539240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27876): Launched 13:45:48.652280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:48.902937 run patchelf(pid=27877): Launched 13:45:49.067892 run osmo-stp_10.42.42.5(pid=27874): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27874)] 13:45:49.194323 run osmo-stp_10.42.42.5(pid=27874): stdout: | (launched: 2022-12-13_13:45:47.860737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:49.321784 run osmo-stp_10.42.42.5(pid=27874): stderr: | 20221213134548025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134548025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134548026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134548026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134548027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134548027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134548027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:49.448876 run osmo-stp_10.42.42.5(pid=27874): stdout: | (launched: 2022-12-13_13:45:47.860737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:49.570690 run osmo-stp_10.42.42.5(pid=27874): stderr: | 20221213134548025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134548025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134548026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134548026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134548027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134548027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134548027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:49.714355 run patchelf(pid=27877): Terminating (SIGINT) 13:45:49.881418 run patchelf(pid=27877): Terminated: ok {rc=0} 13:45:50.001583 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27874): Process ended prematurely: osmo-stp_10.42.42.5(pid=27874) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27874)] [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:45:50.010607 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:45:50.036918 run osmo-hlr_10.42.42.2(pid=27871): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27871)] 13:45:50.084100 run osmo-hlr_10.42.42.2(pid=27871): stdout: | (launched: 2022-12-13_13:45:46.740624) 13:45:50.132757 run osmo-hlr_10.42.42.2(pid=27871): stderr: | 20221213134546989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134546989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134546989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134546989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134546989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134546989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134547004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134547023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134547027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134547027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:50.181645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27870): Terminating (SIGTERM) 13:45:50.221068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27873): Terminating (SIGTERM) 13:45:50.260505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27876): Terminating (SIGTERM) 13:45:50.300006 --- ParallelTerminationStrategy: PID 27870 died... 13:45:50.319065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27870): Terminated: ok {rc=0} 13:45:50.362672 --- ParallelTerminationStrategy: PID 27873 died... 13:45:50.381194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27873): Terminated: ok {rc=0} 13:45:50.424577 --- ParallelTerminationStrategy: PID 27876 died... 13:45:50.442958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27876): Terminated: ok {rc=0} 13:45:50.528182 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:45:51.835504 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:51.842544 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:45:51.878284 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:45:51.914765 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:45:51.971118 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:45:52.003264 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:45:52.037715 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:45:52.601275 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:45:52.606446 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:52.617928 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:45:52.688322 tst switch_tch_pdch.py: using LAC 34349 13:45:52.806511 tst switch_tch_pdch.py: using RAC 179 13:45:52.924297 tst switch_tch_pdch.py: using CellId 34349 13:45:53.040743 tst switch_tch_pdch.py: using BVCI 34350 13:45:53.147450 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.158601 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.169545 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.180554 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.191673 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.203050 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.214388 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:53.225699 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:45:53.344097 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:45:53.460287 tst switch_tch_pdch.py:51: start network... 13:45:53.658185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:54.118359 run create_hlr_db(pid=27884): Launched 13:45:54.238916 bus /gobi_6: Setting Powered False 13:45:55.297402 run create_hlr_db(pid=27884): Terminated: ok {rc=0} 13:45:55.731028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27886): Launched 13:45:56.049082 run osmo-hlr_10.42.42.2(pid=27887): Launched 13:45:56.171514 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:56.722423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27889): Launched 13:45:57.038285 run osmo-stp_10.42.42.5(pid=27890): Launched 13:45:57.159802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:57.706971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27892): Launched 13:45:57.828726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:58.096525 run patchelf(pid=27893): Launched 13:45:58.271902 run osmo-stp_10.42.42.5(pid=27890): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27890)] 13:45:58.406502 run osmo-stp_10.42.42.5(pid=27890): stdout: | (launched: 2022-12-13_13:45:56.980213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:58.542554 run osmo-stp_10.42.42.5(pid=27890): stderr: | 20221213134557167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134557167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134557167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134557167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134557168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134557168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134557168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:58.678618 run osmo-stp_10.42.42.5(pid=27890): stdout: | (launched: 2022-12-13_13:45:56.980213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:58.808461 run osmo-stp_10.42.42.5(pid=27890): stderr: | 20221213134557167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134557167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134557167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134557167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134557168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134557168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134557168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:58.962513 run patchelf(pid=27893): Terminating (SIGINT) 13:45:59.140373 run patchelf(pid=27893): Terminated: ok {rc=0} 13:45:59.269217 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27890): Process ended prematurely: osmo-stp_10.42.42.5(pid=27890) [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27890)] [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:45:59.279007 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:45:59.306923 run osmo-hlr_10.42.42.2(pid=27887): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27887)] 13:45:59.358006 run osmo-hlr_10.42.42.2(pid=27887): stdout: | (launched: 2022-12-13_13:45:55.990904) 13:45:59.409983 run osmo-hlr_10.42.42.2(pid=27887): stderr: | 20221213134556183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134556183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134556183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134556183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134556183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134556183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134556196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134556204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134556204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134556204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:59.462156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27886): Terminating (SIGTERM) 13:45:59.503695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27889): Terminating (SIGTERM) 13:45:59.545669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27892): Terminating (SIGTERM) 13:45:59.587747 --- ParallelTerminationStrategy: PID 27886 died... 13:45:59.607906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27886): Terminated: ok {rc=0} 13:45:59.654524 --- ParallelTerminationStrategy: PID 27889 died... 13:45:59.674246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27889): Terminated: ok {rc=0} 13:45:59.720210 --- ParallelTerminationStrategy: PID 27892 died... 13:45:59.739939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27892): Terminated: ok {rc=0} 13:45:59.827754 bus /gobi_0: Setting Powered False 13:46:00.929137 bus /gobi_0: Setting Powered False 13:46:02.044387 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:46:03.294617 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:03.300817 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:46:03.334678 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:46:03.371553 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:46:03.426375 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:46:03.460135 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:46:03.495470 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:46:04.051433 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:46:04.056768 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.068189 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:46:04.139418 tst switch_tch_pdch.py: using LAC 34350 13:46:04.265708 tst switch_tch_pdch.py: using RAC 180 13:46:04.382389 tst switch_tch_pdch.py: using CellId 34350 13:46:04.499127 tst switch_tch_pdch.py: using BVCI 34351 13:46:04.606460 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.617460 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.628140 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.638861 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.649522 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.660218 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.671049 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:04.681737 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:46:04.800426 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:46:04.918004 tst switch_tch_pdch.py:51: start network... 13:46:05.113961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:05.546724 run create_hlr_db(pid=27897): Launched 13:46:05.667468 bus /gobi_6: Setting Powered False 13:46:06.726416 run create_hlr_db(pid=27897): Terminated: ok {rc=0} 13:46:07.132547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27899): Launched 13:46:07.450280 run osmo-hlr_10.42.42.2(pid=27900): Launched 13:46:07.573164 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:08.096590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27902): Launched 13:46:08.413549 run osmo-stp_10.42.42.5(pid=27903): Launched 13:46:08.536256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:09.058403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27905): Launched 13:46:09.179744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:09.448340 run patchelf(pid=27906): Launched 13:46:09.624167 run osmo-stp_10.42.42.5(pid=27903): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27903)] 13:46:09.758258 run osmo-stp_10.42.42.5(pid=27903): stdout: | (launched: 2022-12-13_13:46:08.355120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:09.894196 run osmo-stp_10.42.42.5(pid=27903): stderr: | 20221213134608542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134608543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134608543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134608543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134608544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134608544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134608544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:10.030157 run osmo-stp_10.42.42.5(pid=27903): stdout: | (launched: 2022-12-13_13:46:08.355120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:10.160093 run osmo-stp_10.42.42.5(pid=27903): stderr: | 20221213134608542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134608543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134608543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134608543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134608544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134608544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134608544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:10.314508 run patchelf(pid=27906): Terminating (SIGINT) 13:46:10.492162 run patchelf(pid=27906): Terminated: ok {rc=0} 13:46:10.620385 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27903): Process ended prematurely: osmo-stp_10.42.42.5(pid=27903) [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27903)] [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:46:10.630125 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:46:10.657825 run osmo-hlr_10.42.42.2(pid=27900): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27900)] 13:46:10.708012 run osmo-hlr_10.42.42.2(pid=27900): stdout: | (launched: 2022-12-13_13:46:07.391857) 13:46:10.759834 run osmo-hlr_10.42.42.2(pid=27900): stderr: | 20221213134607586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134607586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134607586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134607586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134607586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134607586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134607600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134607610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134607610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134607610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:10.812178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27899): Terminating (SIGTERM) 13:46:10.853607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27902): Terminating (SIGTERM) 13:46:10.895907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27905): Terminating (SIGTERM) 13:46:10.938128 --- ParallelTerminationStrategy: PID 27899 died... 13:46:10.958309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27899): Terminated: ok {rc=0} 13:46:11.004069 --- ParallelTerminationStrategy: PID 27902 died... 13:46:11.023673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27902): Terminated: ok {rc=0} 13:46:11.069607 --- ParallelTerminationStrategy: PID 27905 died... 13:46:11.089329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27905): Terminated: ok {rc=0} 13:46:11.176536 bus /gobi_0: Setting Powered False 13:46:12.274800 bus /gobi_0: Setting Powered False 13:46:13.390972 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:trx-lms --------------------------------------------------------------------- 13:46:14.642919 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:14.647468 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:46:14.681229 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:46:14.689024 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:46:14.742630 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:46:14.777677 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:46:14.784932 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:46:15.321653 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:46:15.327063 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 13:46:15.338385 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 13:46:15.387613 tst mo_mt_sms.py: using LAC 34351 13:46:15.513889 tst mo_mt_sms.py: using RAC 181 13:46:15.637418 tst mo_mt_sms.py: using CellId 34351 13:46:15.763341 tst mo_mt_sms.py: using BVCI 34352 13:46:15.890978 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:46:16.019996 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:46:16.154884 tst mo_mt_sms.py:9: start nitb and bts... 13:46:16.397518 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:46:17.021263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27910): Launched 13:46:17.339557 run osmo-nitb_10.42.42.2(pid=27911): Launched 13:46:17.507589 run osmo-nitb_10.42.42.2(pid=27911): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27911)] 13:46:17.641765 run osmo-nitb_10.42.42.2(pid=27911): stdout: | (launched: 2022-12-13_13:46:17.285131) 13:46:17.776441 run osmo-nitb_10.42.42.2(pid=27911): stderr: | (launched: 2022-12-13_13:46:17.329098) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:17.911244 run osmo-nitb_10.42.42.2(pid=27911): stdout: | (launched: 2022-12-13_13:46:17.285131) 13:46:18.040494 run osmo-nitb_10.42.42.2(pid=27911): stderr: | (launched: 2022-12-13_13:46:17.329098) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27911) [trial-2390↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27911)] 13:46:18.455737 tst osmo-nitb_10.42.42.2(pid=27911): stdout: | (launched: 2022-12-13_13:46:17.285131) 13:46:18.574792 tst osmo-nitb_10.42.42.2(pid=27911): stderr: | (launched: 2022-12-13_13:46:17.329098) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:18.714820 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27911) [trial-2390↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27911)] [trial-2390↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 13:46:18.723193 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:46:18.729765 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27910): Terminating (SIGTERM) 13:46:18.937886 --- ParallelTerminationStrategy: PID 27910 died... 13:46:18.958640 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27910): Terminated: ok {rc=0} 13:46:19.043765 bus /sierra_3: Setting Powered False 13:46:20.143168 bus /sierra_3: Setting Powered False 13:46:21.257135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:trx-lms --------------------------------------------------------------------- 13:46:22.453286 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:22.457303 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:46:22.489668 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:46:22.516104 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:46:22.566774 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:46:22.599378 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:46:22.625906 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:46:23.173013 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:46:23.177877 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.188165 tst sms:trx-lms: Using 1 x bts (candidates: 1) 13:46:23.238028 tst mo_mt_sms.py: using LAC 34352 13:46:23.352646 tst mo_mt_sms.py: using RAC 182 13:46:23.467784 tst mo_mt_sms.py: using CellId 34352 13:46:23.583115 tst mo_mt_sms.py: using BVCI 34353 13:46:23.699464 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.710462 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.721299 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.732019 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.743136 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:23.754321 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:46:23.870602 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:46:23.993401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:24.484864 run create_hlr_db(pid=27915): Launched 13:46:24.605352 bus /sierra_2: Setting Powered False 13:46:25.668046 run create_hlr_db(pid=27915): Terminated: ok {rc=0} 13:46:26.091750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27917): Launched 13:46:26.387594 run osmo-hlr_10.42.42.2(pid=27918): Launched 13:46:26.499515 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:27.011060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27920): Launched 13:46:27.307221 run osmo-stp_10.42.42.5(pid=27921): Launched 13:46:27.418649 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:27.954982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27923): Launched 13:46:28.250706 run osmo-msc_10.42.42.6(pid=27924): Launched 13:46:28.415242 run osmo-stp_10.42.42.5(pid=27921): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27921)] 13:46:28.540014 run osmo-stp_10.42.42.5(pid=27921): stdout: | (launched: 2022-12-13_13:46:27.251903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:28.664844 run osmo-stp_10.42.42.5(pid=27921): stderr: | 20221213134627418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134627418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134627418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134627419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134627419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134627419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134627419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:28.787486 run osmo-stp_10.42.42.5(pid=27921): stdout: | (launched: 2022-12-13_13:46:27.251903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:28.904592 run osmo-stp_10.42.42.5(pid=27921): stderr: | 20221213134627418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134627418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134627418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134627419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134627419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134627419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134627419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:29.044529 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27921): Process ended prematurely: osmo-stp_10.42.42.5(pid=27921) [trial-2390↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27921)] [trial-2390↪sms:trx-lms↪mo_mt_sms.py:16] 13:46:29.052883 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:46:29.078380 run osmo-hlr_10.42.42.2(pid=27918): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27918)] 13:46:29.125126 run osmo-hlr_10.42.42.2(pid=27918): stdout: | (launched: 2022-12-13_13:46:26.332667) 13:46:29.173609 run osmo-hlr_10.42.42.2(pid=27918): stderr: | 20221213134626505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134626505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134626505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134626505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134626505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134626505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134626520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134626531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134626531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134626531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:29.240818 run osmo-msc_10.42.42.6(pid=27924): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27924)] 13:46:29.287144 run osmo-msc_10.42.42.6(pid=27924): stdout: | (launched: 2022-12-13_13:46:28.196125) 13:46:29.335206 run osmo-msc_10.42.42.6(pid=27924): stderr: | 20221213134628462 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134628462 DLGLOBAL DEBUG validating counter group 0x7f339db37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134628463 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134628463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134628463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134628463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134628465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134628465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134628465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134628465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:29.383744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27917): Terminating (SIGTERM) 13:46:29.422971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27920): Terminating (SIGTERM) 13:46:29.461822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27923): Terminating (SIGTERM) 13:46:29.501371 --- ParallelTerminationStrategy: PID 27917 died... 13:46:29.520130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27917): Terminated: ok {rc=0} 13:46:29.563358 --- ParallelTerminationStrategy: PID 27920 died... 13:46:29.581559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27920): Terminated: ok {rc=0} 13:46:29.624358 --- ParallelTerminationStrategy: PID 27923 died... 13:46:29.642584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27923): Terminated: ok {rc=0} 13:46:29.727102 bus /sierra_3: Setting Powered False 13:46:30.825339 bus /sierra_3: Setting Powered False 13:46:31.955456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-lms --------------------------------------------------------------------- 13:46:33.179381 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:33.183008 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:46:33.215518 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:46:33.223156 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:46:33.259410 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:46:33.293511 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:46:33.300776 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:46:33.820853 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 13:46:33.826028 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 13:46:33.837114 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 13:46:33.894075 tst assert_extension.py: using LAC 34353 13:46:34.016898 tst assert_extension.py: using RAC 183 13:46:34.139145 tst assert_extension.py: using CellId 34353 13:46:34.261461 tst assert_extension.py: using BVCI 34354 13:46:34.377949 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 13:46:34.491589 tst assert_extension.py:10: start nitb and bts... 13:46:34.689286 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:46:35.292916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27929): Launched 13:46:35.588888 run osmo-nitb_10.42.42.2(pid=27930): Launched 13:46:35.751782 run osmo-nitb_10.42.42.2(pid=27930): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27930)] 13:46:35.884007 run osmo-nitb_10.42.42.2(pid=27930): stdout: | (launched: 2022-12-13_13:46:35.533943) 13:46:36.017581 run osmo-nitb_10.42.42.2(pid=27930): stderr: | (launched: 2022-12-13_13:46:35.578299) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:36.151254 run osmo-nitb_10.42.42.2(pid=27930): stdout: | (launched: 2022-12-13_13:46:35.533943) 13:46:36.278801 run osmo-nitb_10.42.42.2(pid=27930): stderr: | (launched: 2022-12-13_13:46:35.578299) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27930): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27930) [trial-2390↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27930)] 13:46:36.700275 tst osmo-nitb_10.42.42.2(pid=27930): stdout: | (launched: 2022-12-13_13:46:35.533943) 13:46:36.819523 tst osmo-nitb_10.42.42.2(pid=27930): stderr: | (launched: 2022-12-13_13:46:35.578299) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:36.959535 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27930): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27930) [trial-2390↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27930)] [trial-2390↪nitb_ussd:trx-lms↪assert_extension.py:12] 13:46:36.967952 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:46:36.974978 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27929): Terminating (SIGTERM) 13:46:37.182842 --- ParallelTerminationStrategy: PID 27929 died... 13:46:37.203438 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27929): Terminated: ok {rc=0} 13:46:37.288600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:trx-lms --------------------------------------------------------------------- 13:46:38.469913 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:38.473740 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:46:38.506148 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:46:38.532473 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:46:38.565840 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:46:38.598556 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:46:38.624826 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:46:39.154779 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:trx-lms assert_extension.py ---------------------------------------------- 13:46:39.159760 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.170246 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 13:46:39.216091 tst assert_extension.py: using LAC 34354 13:46:39.330465 tst assert_extension.py: using RAC 184 13:46:39.443511 tst assert_extension.py: using CellId 34354 13:46:39.567750 tst assert_extension.py: using BVCI 34355 13:46:39.683033 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.694189 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.705261 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.716155 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.727705 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:46:39.738968 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 13:46:39.854372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:40.311923 run create_hlr_db(pid=27934): Launched 13:46:40.436467 bus /sierra_2: Setting Powered False 13:46:41.499310 run create_hlr_db(pid=27934): Terminated: ok {rc=0} 13:46:41.924165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27936): Launched 13:46:42.221305 run osmo-hlr_10.42.42.2(pid=27937): Launched 13:46:42.333251 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:42.848028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27939): Launched 13:46:43.143539 run osmo-stp_10.42.42.5(pid=27940): Launched 13:46:43.254933 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:43.790117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27942): Launched 13:46:44.085768 run osmo-msc_10.42.42.6(pid=27943): Launched 13:46:44.251637 run osmo-stp_10.42.42.5(pid=27940): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27940)] 13:46:44.377159 run osmo-stp_10.42.42.5(pid=27940): stdout: | (launched: 2022-12-13_13:46:43.088213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:44.503112 run osmo-stp_10.42.42.5(pid=27940): stderr: | 20221213134643254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134643254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134643255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134643255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134643256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134643256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134643256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:44.626731 run osmo-stp_10.42.42.5(pid=27940): stdout: | (launched: 2022-12-13_13:46:43.088213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:44.744747 run osmo-stp_10.42.42.5(pid=27940): stderr: | 20221213134643254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134643254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134643255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134643255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134643256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134643256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134643256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:44.886177 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27940): Process ended prematurely: osmo-stp_10.42.42.5(pid=27940) [trial-2390↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27940)] [trial-2390↪ussd:trx-lms↪assert_extension.py:17] 13:46:44.894351 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:46:44.920039 run osmo-hlr_10.42.42.2(pid=27937): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27937)] 13:46:44.967071 run osmo-hlr_10.42.42.2(pid=27937): stdout: | (launched: 2022-12-13_13:46:42.166749) 13:46:45.015582 run osmo-hlr_10.42.42.2(pid=27937): stderr: | 20221213134642337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134642337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134642337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134642337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134642338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134642338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134642350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134642359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134642359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134642359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:45.083338 run osmo-msc_10.42.42.6(pid=27943): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27943)] 13:46:45.130438 run osmo-msc_10.42.42.6(pid=27943): stdout: | (launched: 2022-12-13_13:46:44.030972) 13:46:45.179061 run osmo-msc_10.42.42.6(pid=27943): stderr: | 20221213134644298 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134644298 DLGLOBAL DEBUG validating counter group 0x7f93e153ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134644298 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134644298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134644298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134644299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134644300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134644301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134644301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134644301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:45.227994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27936): Terminating (SIGTERM) 13:46:45.267378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27939): Terminating (SIGTERM) 13:46:45.306711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27942): Terminating (SIGTERM) 13:46:45.346288 --- ParallelTerminationStrategy: PID 27936 died... 13:46:45.365110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27936): Terminated: ok {rc=0} 13:46:45.408367 --- ParallelTerminationStrategy: PID 27939 died... 13:46:45.426792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27939): Terminated: ok {rc=0} 13:46:45.469846 --- ParallelTerminationStrategy: PID 27942 died... 13:46:45.488145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27942): Terminated: ok {rc=0} 13:46:45.572200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:46:46.784080 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:46.791395 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:46:46.827826 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:46:46.856731 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:46:46.910781 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:46:46.968159 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:46:47.001780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:46:47.526239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:46:47.579096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:47.590697 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:46:47.659934 tst mo_mt_call.py: using LAC 34355 13:46:47.781298 tst mo_mt_call.py: using RAC 185 13:46:47.898887 tst mo_mt_call.py: using CellId 34355 13:46:48.015478 tst mo_mt_call.py: using BVCI 34356 13:46:48.125106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:48.136072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:48.146906 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:48.157871 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:48.168726 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:48.179663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:48.300325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:48.417422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:48.885116 run create_hlr_db(pid=27948): Launched 13:46:49.009312 bus /sierra_2: Setting Powered False 13:46:50.069284 run create_hlr_db(pid=27948): Terminated: ok {rc=0} 13:46:50.510029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Launched 13:46:50.832643 run osmo-hlr_10.42.42.2(pid=27951): Launched 13:46:50.955250 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:51.512402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Launched 13:46:51.836548 run osmo-stp_10.42.42.5(pid=27954): Launched 13:46:51.960078 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:52.543025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Launched 13:46:52.865071 run osmo-msc_10.42.42.6(pid=27957): Launched 13:46:53.043577 run osmo-stp_10.42.42.5(pid=27954): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] 13:46:53.180078 run osmo-stp_10.42.42.5(pid=27954): stdout: | (launched: 2022-12-13_13:46:51.776818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:53.317210 run osmo-stp_10.42.42.5(pid=27954): stderr: | 20221213134651966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134651966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134651966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134651967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134651967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134651967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134651967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:53.452493 run osmo-stp_10.42.42.5(pid=27954): stdout: | (launched: 2022-12-13_13:46:51.776818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:53.580745 run osmo-stp_10.42.42.5(pid=27954): stderr: | 20221213134651966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134651966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134651966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134651967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134651967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134651967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134651967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:53.734291 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27954): Process ended prematurely: osmo-stp_10.42.42.5(pid=27954) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:46:53.743828 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:46:53.771315 run osmo-hlr_10.42.42.2(pid=27951): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27951)] 13:46:53.821784 run osmo-hlr_10.42.42.2(pid=27951): stdout: | (launched: 2022-12-13_13:46:50.773281) 13:46:53.873676 run osmo-hlr_10.42.42.2(pid=27951): stderr: | 20221213134650969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134650969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134650969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134650969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134650969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134650969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134650981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134650990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134650990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134650990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:53.945604 run osmo-msc_10.42.42.6(pid=27957): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27957)] 13:46:53.995204 run osmo-msc_10.42.42.6(pid=27957): stdout: | (launched: 2022-12-13_13:46:52.805659) 13:46:54.047026 run osmo-msc_10.42.42.6(pid=27957): stderr: | 20221213134653125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134653125 DLGLOBAL DEBUG validating counter group 0x7fd14d523c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134653125 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134653125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134653125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134653125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134653127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134653127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134653127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134653128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:54.099110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Terminating (SIGTERM) 13:46:54.140470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Terminating (SIGTERM) 13:46:54.182336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Terminating (SIGTERM) 13:46:54.224396 --- ParallelTerminationStrategy: PID 27950 died... 13:46:54.244630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Terminated: ok {rc=0} 13:46:54.291163 --- ParallelTerminationStrategy: PID 27953 died... 13:46:54.310819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Terminated: ok {rc=0} 13:46:54.356860 --- ParallelTerminationStrategy: PID 27956 died... 13:46:54.377164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Terminated: ok {rc=0} 13:46:54.465861 bus /sierra_3: Setting Powered False 13:46:55.565678 bus /sierra_3: Setting Powered False 13:46:56.682175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:46:57.831999 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:57.844101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:46:57.916884 tst mo_mt_call_osmux.py: using LAC 34356 13:46:58.045359 tst mo_mt_call_osmux.py: using RAC 186 13:46:58.172801 tst mo_mt_call_osmux.py: using CellId 34356 13:46:58.299706 tst mo_mt_call_osmux.py: using BVCI 34357 13:46:58.418956 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:58.430891 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:58.442334 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:58.453804 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:58.465604 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:58.477450 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:58.598887 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:58.719429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:59.185604 run create_hlr_db(pid=27959): Launched 13:46:59.310634 bus /sierra_2: Setting Powered False 13:47:00.370303 run create_hlr_db(pid=27959): Terminated: ok {rc=0} 13:47:00.811406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Launched 13:47:01.175889 run osmo-hlr_10.42.42.2(pid=27962): Launched 13:47:01.415549 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:02.089695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Launched 13:47:02.429133 run osmo-stp_10.42.42.5(pid=27965): Launched 13:47:02.555486 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:03.143677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Launched 13:47:03.468640 run osmo-msc_10.42.42.6(pid=27968): Launched 13:47:03.648620 run osmo-stp_10.42.42.5(pid=27965): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] 13:47:03.785142 run osmo-stp_10.42.42.5(pid=27965): stdout: | (launched: 2022-12-13_13:47:02.369545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:03.922187 run osmo-stp_10.42.42.5(pid=27965): stderr: | 20221213134702557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134702557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134702557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134702558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134702558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134702558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134702559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:04.057385 run osmo-stp_10.42.42.5(pid=27965): stdout: | (launched: 2022-12-13_13:47:02.369545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:04.186155 run osmo-stp_10.42.42.5(pid=27965): stderr: | 20221213134702557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134702557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134702557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134702558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134702558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134702558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134702559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:04.339673 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27965): Process ended prematurely: osmo-stp_10.42.42.5(pid=27965) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:47:04.349461 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:47:04.377235 run osmo-hlr_10.42.42.2(pid=27962): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27962)] 13:47:04.428271 run osmo-hlr_10.42.42.2(pid=27962): stdout: | (launched: 2022-12-13_13:47:01.118682) 13:47:04.480464 run osmo-hlr_10.42.42.2(pid=27962): stderr: | 20221213134701455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134701455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134701455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134701456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134701456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134701456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134701471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134701481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134701481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134701481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:04.552588 run osmo-msc_10.42.42.6(pid=27968): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27968)] 13:47:04.601996 run osmo-msc_10.42.42.6(pid=27968): stdout: | (launched: 2022-12-13_13:47:03.408347) 13:47:04.654069 run osmo-msc_10.42.42.6(pid=27968): stderr: | 20221213134703728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134703729 DLGLOBAL DEBUG validating counter group 0x7f328fa7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134703729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134703729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134703729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134703729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134703731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134703731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134703731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134703732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:04.706083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Terminating (SIGTERM) 13:47:04.747545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Terminating (SIGTERM) 13:47:04.789499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Terminating (SIGTERM) 13:47:04.831879 --- ParallelTerminationStrategy: PID 27961 died... 13:47:04.852052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Terminated: ok {rc=0} 13:47:04.898363 --- ParallelTerminationStrategy: PID 27964 died... 13:47:04.918017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Terminated: ok {rc=0} 13:47:04.963867 --- ParallelTerminationStrategy: PID 27967 died... 13:47:04.983481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Terminated: ok {rc=0} 13:47:05.070666 bus /sierra_3: Setting Powered False 13:47:06.169982 bus /sierra_3: Setting Powered False 13:47:07.286458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:47:08.539751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:08.547441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:47:08.580646 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:47:08.607200 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:47:08.658088 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:47:08.691659 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:47:08.718291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:47:09.268578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:47:09.323839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.335471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:47:09.406619 tst mo_mt_call.py: using LAC 34357 13:47:09.535086 tst mo_mt_call.py: using RAC 187 13:47:09.661867 tst mo_mt_call.py: using CellId 34357 13:47:09.790846 tst mo_mt_call.py: using BVCI 34358 13:47:09.909014 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.920646 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.932067 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.943353 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.955112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:09.966877 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:10.083186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:10.199192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:10.669556 run create_hlr_db(pid=27973): Launched 13:47:10.794093 bus /sierra_2: Setting Powered False 13:47:11.854286 run create_hlr_db(pid=27973): Terminated: ok {rc=0} 13:47:12.296657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Launched 13:47:12.621982 run osmo-hlr_10.42.42.2(pid=27976): Launched 13:47:12.746777 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:13.307528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Launched 13:47:13.632505 run osmo-stp_10.42.42.5(pid=27979): Launched 13:47:13.755109 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:14.337857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Launched 13:47:14.663188 run osmo-msc_10.42.42.6(pid=27982): Launched 13:47:14.844356 run osmo-stp_10.42.42.5(pid=27979): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] 13:47:14.980604 run osmo-stp_10.42.42.5(pid=27979): stdout: | (launched: 2022-12-13_13:47:13.572570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:15.117561 run osmo-stp_10.42.42.5(pid=27979): stderr: | 20221213134713762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134713762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134713762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134713763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134713763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134713763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134713763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:15.252226 run osmo-stp_10.42.42.5(pid=27979): stdout: | (launched: 2022-12-13_13:47:13.572570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:15.380391 run osmo-stp_10.42.42.5(pid=27979): stderr: | 20221213134713762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134713762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134713762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134713763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134713763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134713763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134713763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:15.534332 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27979): Process ended prematurely: osmo-stp_10.42.42.5(pid=27979) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:47:15.543998 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:47:15.571680 run osmo-hlr_10.42.42.2(pid=27976): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27976)] 13:47:15.622134 run osmo-hlr_10.42.42.2(pid=27976): stdout: | (launched: 2022-12-13_13:47:12.562692) 13:47:15.673834 run osmo-hlr_10.42.42.2(pid=27976): stderr: | 20221213134712757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134712757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134712757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134712757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134712757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134712757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134712770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134712779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134712779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134712779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:15.745821 run osmo-msc_10.42.42.6(pid=27982): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27982)] 13:47:15.795404 run osmo-msc_10.42.42.6(pid=27982): stdout: | (launched: 2022-12-13_13:47:14.604005) 13:47:15.849592 run osmo-msc_10.42.42.6(pid=27982): stderr: | 20221213134714922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134714922 DLGLOBAL DEBUG validating counter group 0x7fca24509c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134714922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134714922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134714922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134714922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134714924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134714924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134714925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134714925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:15.918499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Terminating (SIGTERM) 13:47:15.961991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Terminating (SIGTERM) 13:47:16.007999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Terminating (SIGTERM) 13:47:16.059843 --- ParallelTerminationStrategy: PID 27975 died... 13:47:16.085627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Terminated: ok {rc=0} 13:47:16.145499 --- ParallelTerminationStrategy: PID 27978 died... 13:47:16.170443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Terminated: ok {rc=0} 13:47:16.232419 --- ParallelTerminationStrategy: PID 27981 died... 13:47:16.258418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Terminated: ok {rc=0} 13:47:16.370222 bus /sierra_3: Setting Powered False 13:47:17.468526 bus /sierra_3: Setting Powered False 13:47:18.584296 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:47:19.733972 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:19.746401 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:47:19.818786 tst mo_mt_call_osmux.py: using LAC 34358 13:47:19.947672 tst mo_mt_call_osmux.py: using RAC 188 13:47:20.067927 tst mo_mt_call_osmux.py: using CellId 34358 13:47:20.188378 tst mo_mt_call_osmux.py: using BVCI 34359 13:47:20.307698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:20.319484 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:20.331120 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:20.342636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:20.354596 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:20.366656 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:20.484223 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:20.601161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:21.068759 run create_hlr_db(pid=27984): Launched 13:47:21.192878 bus /sierra_2: Setting Powered False 13:47:22.252479 run create_hlr_db(pid=27984): Terminated: ok {rc=0} 13:47:22.671999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27986): Launched 13:47:22.974534 run osmo-hlr_10.42.42.2(pid=27987): Launched 13:47:23.090810 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:23.609310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27989): Launched 13:47:23.910694 run osmo-stp_10.42.42.5(pid=27990): Launched 13:47:24.026326 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:24.570321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27992): Launched 13:47:24.873030 run osmo-msc_10.42.42.6(pid=27993): Launched 13:47:25.041647 run osmo-stp_10.42.42.5(pid=27990): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27990)] 13:47:25.169293 run osmo-stp_10.42.42.5(pid=27990): stdout: | (launched: 2022-12-13_13:47:23.854969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:25.297339 run osmo-stp_10.42.42.5(pid=27990): stderr: | 20221213134724021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134724021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134724022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134724022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134724022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134724023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134724023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:25.422578 run osmo-stp_10.42.42.5(pid=27990): stdout: | (launched: 2022-12-13_13:47:23.854969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:25.542380 run osmo-stp_10.42.42.5(pid=27990): stderr: | 20221213134724021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134724021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134724022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134724022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134724022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134724023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134724023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:25.685142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27990): Process ended prematurely: osmo-stp_10.42.42.5(pid=27990) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27990)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:47:25.694127 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:47:25.720231 run osmo-hlr_10.42.42.2(pid=27987): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27987)] 13:47:25.767278 run osmo-hlr_10.42.42.2(pid=27987): stdout: | (launched: 2022-12-13_13:47:22.918840) 13:47:25.816453 run osmo-hlr_10.42.42.2(pid=27987): stderr: | 20221213134723091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134723091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134723092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134723092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134723092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134723092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134723106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134723116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134723116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134723116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:25.884691 run osmo-msc_10.42.42.6(pid=27993): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27993)] 13:47:25.931884 run osmo-msc_10.42.42.6(pid=27993): stdout: | (launched: 2022-12-13_13:47:24.817186) 13:47:25.980713 run osmo-msc_10.42.42.6(pid=27993): stderr: | 20221213134725087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134725087 DLGLOBAL DEBUG validating counter group 0x7fd6cfc8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134725087 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134725087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134725087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134725087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134725089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134725090 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134725090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134725090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:26.029555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27986): Terminating (SIGTERM) 13:47:26.068721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27989): Terminating (SIGTERM) 13:47:26.107949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27992): Terminating (SIGTERM) 13:47:26.147126 --- ParallelTerminationStrategy: PID 27986 died... 13:47:26.165992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27986): Terminated: ok {rc=0} 13:47:26.209515 --- ParallelTerminationStrategy: PID 27989 died... 13:47:26.227772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27989): Terminated: ok {rc=0} 13:47:26.271023 --- ParallelTerminationStrategy: PID 27992 died... 13:47:26.289315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27992): Terminated: ok {rc=0} 13:47:26.372143 bus /sierra_3: Setting Powered False 13:47:27.465894 bus /sierra_3: Setting Powered False 13:47:28.576586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:47:29.826862 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:29.834152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:47:29.868516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:47:29.896265 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:47:29.950448 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:47:29.985868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:47:30.013754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:47:30.563303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:47:30.615698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:30.627226 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:47:30.699829 tst mo_mt_call.py: using LAC 34359 13:47:30.833277 tst mo_mt_call.py: using RAC 189 13:47:30.975097 tst mo_mt_call.py: using CellId 34359 13:47:31.134263 tst mo_mt_call.py: using BVCI 34360 13:47:31.283629 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:31.295648 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:31.307595 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:31.319270 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:31.331467 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:31.348890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:31.470961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:31.627604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:32.140479 run create_hlr_db(pid=27998): Launched 13:47:32.303150 bus /sierra_2: Setting Powered False 13:47:33.366938 run create_hlr_db(pid=27998): Terminated: ok {rc=0} 13:47:33.800253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28000): Launched 13:47:34.104914 run osmo-hlr_10.42.42.2(pid=28001): Launched 13:47:34.219710 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:34.738191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28003): Launched 13:47:35.039346 run osmo-stp_10.42.42.5(pid=28004): Launched 13:47:35.152627 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:35.696475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28006): Launched 13:47:35.998407 run osmo-msc_10.42.42.6(pid=28007): Launched 13:47:36.169664 run osmo-stp_10.42.42.5(pid=28004): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28004)] 13:47:36.296086 run osmo-stp_10.42.42.5(pid=28004): stdout: | (launched: 2022-12-13_13:47:34.983438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:36.423007 run osmo-stp_10.42.42.5(pid=28004): stderr: | 20221213134735152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134735152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134735152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134735153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134735153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134735153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134735153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:36.548198 run osmo-stp_10.42.42.5(pid=28004): stdout: | (launched: 2022-12-13_13:47:34.983438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:36.667346 run osmo-stp_10.42.42.5(pid=28004): stderr: | 20221213134735152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134735152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134735152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134735153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134735153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134735153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134735153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:36.809950 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28004): Process ended prematurely: osmo-stp_10.42.42.5(pid=28004) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28004)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:47:36.818959 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:47:36.845123 run osmo-hlr_10.42.42.2(pid=28001): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28001)] 13:47:36.892046 run osmo-hlr_10.42.42.2(pid=28001): stdout: | (launched: 2022-12-13_13:47:34.048844) 13:47:36.941097 run osmo-hlr_10.42.42.2(pid=28001): stderr: | 20221213134734220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134734221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134734221 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134734221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134734221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134734221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134734234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134734242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134734242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134734242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:37.008378 run osmo-msc_10.42.42.6(pid=28007): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28007)] 13:47:37.055131 run osmo-msc_10.42.42.6(pid=28007): stdout: | (launched: 2022-12-13_13:47:35.942391) 13:47:37.103592 run osmo-msc_10.42.42.6(pid=28007): stderr: | 20221213134736212 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134736212 DLGLOBAL DEBUG validating counter group 0x7fcdd31cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134736212 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134736212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134736212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134736213 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134736214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134736215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134736215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134736215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:37.152447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28000): Terminating (SIGTERM) 13:47:37.191607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28003): Terminating (SIGTERM) 13:47:37.230554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28006): Terminating (SIGTERM) 13:47:37.269830 --- ParallelTerminationStrategy: PID 28000 died... 13:47:37.288698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28000): Terminated: ok {rc=0} 13:47:37.332177 --- ParallelTerminationStrategy: PID 28003 died... 13:47:37.350616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28003): Terminated: ok {rc=0} 13:47:37.393864 --- ParallelTerminationStrategy: PID 28006 died... 13:47:37.412243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28006): Terminated: ok {rc=0} 13:47:37.498167 bus /sierra_3: Setting Powered False 13:47:38.596251 bus /sierra_3: Setting Powered False 13:47:39.710551 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:47:40.854896 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:40.866678 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:47:40.935973 tst mo_mt_call_osmux.py: using LAC 34360 13:47:41.054592 tst mo_mt_call_osmux.py: using RAC 190 13:47:41.174478 tst mo_mt_call_osmux.py: using CellId 34360 13:47:41.294554 tst mo_mt_call_osmux.py: using BVCI 34361 13:47:41.405177 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:41.416199 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:41.427095 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:41.437950 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:41.448842 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:41.460216 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:41.575452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:41.695862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:42.197926 run create_hlr_db(pid=28009): Launched 13:47:42.323528 bus /sierra_2: Setting Powered False 13:47:43.388028 run create_hlr_db(pid=28009): Terminated: ok {rc=0} 13:47:43.819841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28011): Launched 13:47:44.123946 run osmo-hlr_10.42.42.2(pid=28012): Launched 13:47:44.238298 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:44.775011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28014): Launched 13:47:45.077597 run osmo-stp_10.42.42.5(pid=28015): Launched 13:47:45.192692 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:45.742197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28017): Launched 13:47:46.060122 run osmo-msc_10.42.42.6(pid=28018): Launched 13:47:46.530433 run osmo-stp_10.42.42.5(pid=28015): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28015)] 13:47:46.857014 run osmo-stp_10.42.42.5(pid=28015): stdout: | (launched: 2022-12-13_13:47:45.021817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:47.040904 run osmo-stp_10.42.42.5(pid=28015): stderr: | 20221213134745187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134745187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134745187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134745188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134745188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134745188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134745189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:47.180308 run osmo-stp_10.42.42.5(pid=28015): stdout: | (launched: 2022-12-13_13:47:45.021817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:47.301941 run osmo-stp_10.42.42.5(pid=28015): stderr: | 20221213134745187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134745187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134745187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134745188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134745188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134745188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134745189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:47.447784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28015): Process ended prematurely: osmo-stp_10.42.42.5(pid=28015) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28015)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:47:47.457330 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:47:47.485409 run osmo-hlr_10.42.42.2(pid=28012): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28012)] 13:47:47.533350 run osmo-hlr_10.42.42.2(pid=28012): stdout: | (launched: 2022-12-13_13:47:44.067072) 13:47:47.582918 run osmo-hlr_10.42.42.2(pid=28012): stderr: | 20221213134744241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134744241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134744241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134744241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134744241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134744241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134744254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134744264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134744264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134744264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:47.651916 run osmo-msc_10.42.42.6(pid=28018): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28018)] 13:47:47.699424 run osmo-msc_10.42.42.6(pid=28018): stdout: | (launched: 2022-12-13_13:47:46.003799) 13:47:47.748792 run osmo-msc_10.42.42.6(pid=28018): stderr: | 20221213134746616 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134746617 DLGLOBAL DEBUG validating counter group 0x7f9cb357ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134746618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134746618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134746618 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134746619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134746625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134746625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134746625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134746627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:47.798304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28011): Terminating (SIGTERM) 13:47:47.838046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28014): Terminating (SIGTERM) 13:47:47.877743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28017): Terminating (SIGTERM) 13:47:47.917632 --- ParallelTerminationStrategy: PID 28011 died... 13:47:47.936449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28011): Terminated: ok {rc=0} 13:47:47.980133 --- ParallelTerminationStrategy: PID 28014 died... 13:47:47.998588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28014): Terminated: ok {rc=0} 13:47:48.041709 --- ParallelTerminationStrategy: PID 28017 died... 13:47:48.060100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28017): Terminated: ok {rc=0} 13:47:48.145927 bus /sierra_3: Setting Powered False 13:47:49.243769 bus /sierra_3: Setting Powered False 13:47:50.358587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:47:51.608018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:51.614814 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:47:51.647209 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:47:51.673590 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:47:51.724540 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:47:51.757411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:47:51.783953 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:47:52.335261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:47:52.383722 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.394949 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:47:52.463174 tst mo_mt_call.py: using LAC 34361 13:47:52.583693 tst mo_mt_call.py: using RAC 191 13:47:52.704501 tst mo_mt_call.py: using CellId 34361 13:47:52.824373 tst mo_mt_call.py: using BVCI 34362 13:47:52.934816 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.945897 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.956646 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.967419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.978293 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:52.989209 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:53.110978 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:53.230256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:53.733232 run create_hlr_db(pid=28023): Launched 13:47:53.858086 bus /sierra_2: Setting Powered False 13:47:54.921665 run create_hlr_db(pid=28023): Terminated: ok {rc=0} 13:47:55.351687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28025): Launched 13:47:55.654813 run osmo-hlr_10.42.42.2(pid=28026): Launched 13:47:55.769209 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:56.304860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28028): Launched 13:47:56.606489 run osmo-stp_10.42.42.5(pid=28029): Launched 13:47:56.721260 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:57.265731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28031): Launched 13:47:57.569305 run osmo-msc_10.42.42.6(pid=28032): Launched 13:47:57.737411 run osmo-stp_10.42.42.5(pid=28029): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28029)] 13:47:57.864370 run osmo-stp_10.42.42.5(pid=28029): stdout: | (launched: 2022-12-13_13:47:56.550548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:57.991801 run osmo-stp_10.42.42.5(pid=28029): stderr: | 20221213134756718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134756718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134756718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134756719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134756719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134756719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134756719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:58.117335 run osmo-stp_10.42.42.5(pid=28029): stdout: | (launched: 2022-12-13_13:47:56.550548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:58.237125 run osmo-stp_10.42.42.5(pid=28029): stderr: | 20221213134756718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134756718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134756718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134756719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134756719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134756719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134756719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:58.379660 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28029): Process ended prematurely: osmo-stp_10.42.42.5(pid=28029) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28029)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:47:58.388778 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:47:58.415210 run osmo-hlr_10.42.42.2(pid=28026): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28026)] 13:47:58.462352 run osmo-hlr_10.42.42.2(pid=28026): stdout: | (launched: 2022-12-13_13:47:55.598881) 13:47:58.511040 run osmo-hlr_10.42.42.2(pid=28026): stderr: | 20221213134755771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134755771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134755771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134755771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134755771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134755771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134755784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134755794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134755794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134755794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:58.579084 run osmo-msc_10.42.42.6(pid=28032): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28032)] 13:47:58.626149 run osmo-msc_10.42.42.6(pid=28032): stdout: | (launched: 2022-12-13_13:47:57.513170) 13:47:58.674653 run osmo-msc_10.42.42.6(pid=28032): stderr: | 20221213134757783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134757783 DLGLOBAL DEBUG validating counter group 0x7fd2cedfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134757783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134757783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134757784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134757784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134757786 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134757786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134757786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134757786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:58.723782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28025): Terminating (SIGTERM) 13:47:58.762761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28028): Terminating (SIGTERM) 13:47:58.801973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28031): Terminating (SIGTERM) 13:47:58.841505 --- ParallelTerminationStrategy: PID 28025 died... 13:47:58.860616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28025): Terminated: ok {rc=0} 13:47:58.904357 --- ParallelTerminationStrategy: PID 28028 died... 13:47:58.922925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28028): Terminated: ok {rc=0} 13:47:58.966324 --- ParallelTerminationStrategy: PID 28031 died... 13:47:58.984749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28031): Terminated: ok {rc=0} 13:47:59.068073 bus /sierra_3: Setting Powered False 13:48:00.163853 bus /sierra_3: Setting Powered False 13:48:01.296784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:48:02.450019 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:02.461758 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:48:02.531539 tst mo_mt_call_osmux.py: using LAC 34362 13:48:02.650492 tst mo_mt_call_osmux.py: using RAC 192 13:48:02.769326 tst mo_mt_call_osmux.py: using CellId 34362 13:48:02.887677 tst mo_mt_call_osmux.py: using BVCI 34363 13:48:02.998777 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:03.009955 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:03.021018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:03.031858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:03.042889 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:48:03.053859 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:48:03.173462 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:48:03.292817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:03.796739 run create_hlr_db(pid=28034): Launched 13:48:03.921528 bus /sierra_2: Setting Powered False 13:48:04.985627 run create_hlr_db(pid=28034): Terminated: ok {rc=0} 13:48:05.435617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28036): Launched 13:48:05.762559 run osmo-hlr_10.42.42.2(pid=28037): Launched 13:48:05.885788 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:06.447245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28039): Launched 13:48:06.773195 run osmo-stp_10.42.42.5(pid=28040): Launched 13:48:06.897472 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:07.484645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28042): Launched 13:48:07.810417 run osmo-msc_10.42.42.6(pid=28043): Launched 13:48:07.992807 run osmo-stp_10.42.42.5(pid=28040): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28040)] 13:48:08.129609 run osmo-stp_10.42.42.5(pid=28040): stdout: | (launched: 2022-12-13_13:48:06.713643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:08.266746 run osmo-stp_10.42.42.5(pid=28040): stderr: | 20221213134806904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134806904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134806904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134806905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134806905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134806905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134806906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:08.402830 run osmo-stp_10.42.42.5(pid=28040): stdout: | (launched: 2022-12-13_13:48:06.713643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:08.532508 run osmo-stp_10.42.42.5(pid=28040): stderr: | 20221213134806904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134806904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134806904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134806905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134806905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134806905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134806906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:08.687910 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28040): Process ended prematurely: osmo-stp_10.42.42.5(pid=28040) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28040)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:48:08.697641 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:48:08.725477 run osmo-hlr_10.42.42.2(pid=28037): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28037)] 13:48:08.776322 run osmo-hlr_10.42.42.2(pid=28037): stdout: | (launched: 2022-12-13_13:48:05.702828) 13:48:08.828757 run osmo-hlr_10.42.42.2(pid=28037): stderr: | 20221213134805898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134805898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134805898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134805898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134805898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134805898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134805913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134805923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134805923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134805923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:08.901640 run osmo-msc_10.42.42.6(pid=28043): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28043)] 13:48:08.951777 run osmo-msc_10.42.42.6(pid=28043): stdout: | (launched: 2022-12-13_13:48:07.750231) 13:48:09.003813 run osmo-msc_10.42.42.6(pid=28043): stderr: | 20221213134808069 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134808069 DLGLOBAL DEBUG validating counter group 0x7f682b701c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134808070 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134808070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134808070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134808070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134808072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134808072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134808072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134808072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:09.056285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28036): Terminating (SIGTERM) 13:48:09.098219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28039): Terminating (SIGTERM) 13:48:09.140909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28042): Terminating (SIGTERM) 13:48:09.183480 --- ParallelTerminationStrategy: PID 28036 died... 13:48:09.203958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28036): Terminated: ok {rc=0} 13:48:09.250696 --- ParallelTerminationStrategy: PID 28039 died... 13:48:09.270483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28039): Terminated: ok {rc=0} 13:48:09.316810 --- ParallelTerminationStrategy: PID 28042 died... 13:48:09.337325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28042): Terminated: ok {rc=0} 13:48:09.424740 bus /sierra_3: Setting Powered False 13:48:10.522551 bus /sierra_3: Setting Powered False 13:48:11.634367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:48:12.890328 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:12.897471 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:48:12.931542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:48:12.960077 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:48:13.012219 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:48:13.045835 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:48:13.073830 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:48:13.624399 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:48:13.677673 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:13.689230 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:48:13.760798 tst mo_mt_call.py: using LAC 34363 13:48:13.888177 tst mo_mt_call.py: using RAC 193 13:48:14.023958 tst mo_mt_call.py: using CellId 34363 13:48:14.150481 tst mo_mt_call.py: using BVCI 34364 13:48:14.268397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:14.280083 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:14.291603 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:14.303094 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:14.315083 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:14.327001 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:14.444113 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:14.564288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:15.065210 run create_hlr_db(pid=28050): Launched 13:48:15.188289 bus /sierra_2: Setting Powered False 13:48:16.247696 run create_hlr_db(pid=28050): Terminated: ok {rc=0} 13:48:16.681322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Launched 13:48:17.002349 run osmo-hlr_10.42.42.2(pid=28053): Launched 13:48:17.167241 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:17.706278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Launched 13:48:18.011051 run osmo-stp_10.42.42.5(pid=28056): Launched 13:48:18.126870 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:18.670932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Launched 13:48:18.974663 run osmo-msc_10.42.42.6(pid=28059): Launched 13:48:19.142161 run osmo-stp_10.42.42.5(pid=28056): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] 13:48:19.269416 run osmo-stp_10.42.42.5(pid=28056): stdout: | (launched: 2022-12-13_13:48:17.954923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:19.398191 run osmo-stp_10.42.42.5(pid=28056): stderr: | 20221213134818122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134818122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134818122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134818123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134818123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134818123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134818123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:19.523633 run osmo-stp_10.42.42.5(pid=28056): stdout: | (launched: 2022-12-13_13:48:17.954923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:19.643125 run osmo-stp_10.42.42.5(pid=28056): stderr: | 20221213134818122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134818122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134818122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134818123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134818123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134818123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134818123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:19.786077 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28056): Process ended prematurely: osmo-stp_10.42.42.5(pid=28056) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:48:19.795046 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:48:19.821192 run osmo-hlr_10.42.42.2(pid=28053): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28053)] 13:48:19.868365 run osmo-hlr_10.42.42.2(pid=28053): stdout: | (launched: 2022-12-13_13:48:16.945828) 13:48:19.917249 run osmo-hlr_10.42.42.2(pid=28053): stderr: | 20221213134817275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134817275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134817275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134817275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134817275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134817275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134817288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134817296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134817296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134817297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:19.985240 run osmo-msc_10.42.42.6(pid=28059): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28059)] 13:48:20.032168 run osmo-msc_10.42.42.6(pid=28059): stdout: | (launched: 2022-12-13_13:48:18.918876) 13:48:20.080834 run osmo-msc_10.42.42.6(pid=28059): stderr: | 20221213134819186 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134819186 DLGLOBAL DEBUG validating counter group 0x7f4a51941c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134819186 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134819186 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134819186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134819187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134819188 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134819189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134819189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134819189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:20.130070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Terminating (SIGTERM) 13:48:20.169566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Terminating (SIGTERM) 13:48:20.209084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Terminating (SIGTERM) 13:48:20.248582 --- ParallelTerminationStrategy: PID 28052 died... 13:48:20.267513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Terminated: ok {rc=0} 13:48:20.310921 --- ParallelTerminationStrategy: PID 28055 died... 13:48:20.329348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Terminated: ok {rc=0} 13:48:20.372837 --- ParallelTerminationStrategy: PID 28058 died... 13:48:20.391318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Terminated: ok {rc=0} 13:48:20.475576 bus /sierra_3: Setting Powered False 13:48:21.575037 bus /sierra_3: Setting Powered False 13:48:22.690652 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:48:23.835983 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:23.847555 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:48:23.916833 tst mo_mt_call_osmux.py: using LAC 34364 13:48:24.036827 tst mo_mt_call_osmux.py: using RAC 194 13:48:24.155210 tst mo_mt_call_osmux.py: using CellId 34364 13:48:24.273282 tst mo_mt_call_osmux.py: using BVCI 34365 13:48:24.382002 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:24.393202 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:24.404258 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:24.415217 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:24.426189 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:24.437151 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:24.552185 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:24.668140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:25.135184 run create_hlr_db(pid=28061): Launched 13:48:25.259325 bus /sierra_2: Setting Powered False 13:48:26.319099 run create_hlr_db(pid=28061): Terminated: ok {rc=0} 13:48:26.760867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28063): Launched 13:48:27.084896 run osmo-hlr_10.42.42.2(pid=28064): Launched 13:48:27.209216 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:27.771224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28066): Launched 13:48:28.095810 run osmo-stp_10.42.42.5(pid=28067): Launched 13:48:28.219919 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:28.804780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28069): Launched 13:48:29.129374 run osmo-msc_10.42.42.6(pid=28070): Launched 13:48:29.309492 run osmo-stp_10.42.42.5(pid=28067): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28067)] 13:48:29.446634 run osmo-stp_10.42.42.5(pid=28067): stdout: | (launched: 2022-12-13_13:48:28.036295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:29.585081 run osmo-stp_10.42.42.5(pid=28067): stderr: | 20221213134828224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134828224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134828225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134828225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134828226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134828226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134828226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:29.722572 run osmo-stp_10.42.42.5(pid=28067): stdout: | (launched: 2022-12-13_13:48:28.036295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:29.851431 run osmo-stp_10.42.42.5(pid=28067): stderr: | 20221213134828224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134828224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134828225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134828225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134828226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134828226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134828226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:30.005611 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28067): Process ended prematurely: osmo-stp_10.42.42.5(pid=28067) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28067)] [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:48:30.015257 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:48:30.042952 run osmo-hlr_10.42.42.2(pid=28064): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28064)] 13:48:30.094180 run osmo-hlr_10.42.42.2(pid=28064): stdout: | (launched: 2022-12-13_13:48:27.025468) 13:48:30.145863 run osmo-hlr_10.42.42.2(pid=28064): stderr: | 20221213134827219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134827219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134827219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134827219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134827219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134827219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134827231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134827239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134827239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134827240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:30.217761 run osmo-msc_10.42.42.6(pid=28070): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28070)] 13:48:30.267417 run osmo-msc_10.42.42.6(pid=28070): stdout: | (launched: 2022-12-13_13:48:29.069960) 13:48:30.319414 run osmo-msc_10.42.42.6(pid=28070): stderr: | 20221213134829389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134829389 DLGLOBAL DEBUG validating counter group 0x7f3f8634bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134829389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134829389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134829389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134829389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134829391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134829391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134829392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134829392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:30.371569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28063): Terminating (SIGTERM) 13:48:30.412901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28066): Terminating (SIGTERM) 13:48:30.455157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28069): Terminating (SIGTERM) 13:48:30.497767 --- ParallelTerminationStrategy: PID 28063 died... 13:48:30.518050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28063): Terminated: ok {rc=0} 13:48:30.564312 --- ParallelTerminationStrategy: PID 28066 died... 13:48:30.584113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28066): Terminated: ok {rc=0} 13:48:30.630066 --- ParallelTerminationStrategy: PID 28069 died... 13:48:30.649764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28069): Terminated: ok {rc=0} 13:48:30.737649 bus /sierra_3: Setting Powered False 13:48:31.836371 bus /sierra_3: Setting Powered False 13:48:32.971407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:48:34.220912 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:34.227997 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:48:34.262339 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:48:34.289971 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:48:34.343282 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:48:34.377905 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:48:34.405567 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:48:34.956446 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:48:35.009114 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.020777 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:35.090850 tst mo_mt_call.py: using LAC 34365 13:48:35.215448 tst mo_mt_call.py: using RAC 195 13:48:35.333470 tst mo_mt_call.py: using CellId 34365 13:48:35.450092 tst mo_mt_call.py: using BVCI 34366 13:48:35.560364 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.571471 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.582442 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.593518 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.604457 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:35.615376 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:35.736668 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:35.855044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:36.324323 run create_hlr_db(pid=28075): Launched 13:48:36.448102 bus /sierra_2: Setting Powered False 13:48:37.507943 run create_hlr_db(pid=28075): Terminated: ok {rc=0} 13:48:37.949485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Launched 13:48:38.275079 run osmo-hlr_10.42.42.2(pid=28078): Launched 13:48:38.400164 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:38.961759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Launched 13:48:39.288392 run osmo-stp_10.42.42.5(pid=28081): Launched 13:48:39.411207 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:39.996129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Launched 13:48:40.299271 run osmo-msc_10.42.42.6(pid=28084): Launched 13:48:40.468040 run osmo-stp_10.42.42.5(pid=28081): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] 13:48:40.596729 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-13_13:48:39.228610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:40.724448 run osmo-stp_10.42.42.5(pid=28081): stderr: | 20221213134839416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134839416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134839416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134839417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134839417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134839417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134839417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:40.850378 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-13_13:48:39.228610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:40.969648 run osmo-stp_10.42.42.5(pid=28081): stderr: | 20221213134839416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134839416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134839416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134839417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134839417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134839417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134839417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:41.112590 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:48:41.121516 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:48:41.147729 run osmo-hlr_10.42.42.2(pid=28078): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28078)] 13:48:41.194936 run osmo-hlr_10.42.42.2(pid=28078): stdout: | (launched: 2022-12-13_13:48:38.215372) 13:48:41.243739 run osmo-hlr_10.42.42.2(pid=28078): stderr: | 20221213134838411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134838411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134838411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134838411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134838411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134838411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134838424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134838434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134838434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134838434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:41.312099 run osmo-msc_10.42.42.6(pid=28084): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28084)] 13:48:41.359060 run osmo-msc_10.42.42.6(pid=28084): stdout: | (launched: 2022-12-13_13:48:40.243341) 13:48:41.407676 run osmo-msc_10.42.42.6(pid=28084): stderr: | 20221213134840514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134840514 DLGLOBAL DEBUG validating counter group 0x7fc07ff84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134840514 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134840514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134840514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134840514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134840516 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134840517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134840517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134840517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:41.456711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminating (SIGTERM) 13:48:41.496076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminating (SIGTERM) 13:48:41.535221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Terminating (SIGTERM) 13:48:41.574554 --- ParallelTerminationStrategy: PID 28077 died... 13:48:41.593511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminated: ok {rc=0} 13:48:41.637280 --- ParallelTerminationStrategy: PID 28080 died... 13:48:41.655892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminated: ok {rc=0} 13:48:41.699295 --- ParallelTerminationStrategy: PID 28083 died... 13:48:41.717663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Terminated: ok {rc=0} 13:48:41.802426 bus /sierra_3: Setting Powered False 13:48:42.900458 bus /sierra_3: Setting Powered False 13:48:44.012775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:48:45.153765 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.165524 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:45.245462 tst mo_mt_call_osmux.py: using LAC 34366 13:48:45.365075 tst mo_mt_call_osmux.py: using RAC 196 13:48:45.484462 tst mo_mt_call_osmux.py: using CellId 34366 13:48:45.613351 tst mo_mt_call_osmux.py: using BVCI 34367 13:48:45.732598 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.744454 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.756125 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.767766 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.780103 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:45.792442 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:45.940858 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:46.063450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:46.592818 run create_hlr_db(pid=28086): Launched 13:48:46.745113 bus /sierra_2: Setting Powered False 13:48:47.806071 run create_hlr_db(pid=28086): Terminated: ok {rc=0} 13:48:48.247623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28088): Launched 13:48:48.573587 run osmo-hlr_10.42.42.2(pid=28089): Launched 13:48:48.698808 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:49.255029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28091): Launched 13:48:49.579105 run osmo-stp_10.42.42.5(pid=28092): Launched 13:48:49.702706 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:50.291487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28094): Launched 13:48:50.616264 run osmo-msc_10.42.42.6(pid=28095): Launched 13:48:50.797221 run osmo-stp_10.42.42.5(pid=28092): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28092)] 13:48:50.933922 run osmo-stp_10.42.42.5(pid=28092): stdout: | (launched: 2022-12-13_13:48:49.519393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:51.071788 run osmo-stp_10.42.42.5(pid=28092): stderr: | 20221213134849710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134849710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134849710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134849710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134849711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134849711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134849711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:51.208789 run osmo-stp_10.42.42.5(pid=28092): stdout: | (launched: 2022-12-13_13:48:49.519393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:51.337827 run osmo-stp_10.42.42.5(pid=28092): stderr: | 20221213134849710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134849710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134849710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134849710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134849711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134849711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134849711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:51.492677 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28092): Process ended prematurely: osmo-stp_10.42.42.5(pid=28092) [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28092)] [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:48:51.502315 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:48:51.530052 run osmo-hlr_10.42.42.2(pid=28089): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28089)] 13:48:51.580238 run osmo-hlr_10.42.42.2(pid=28089): stdout: | (launched: 2022-12-13_13:48:48.514152) 13:48:51.631572 run osmo-hlr_10.42.42.2(pid=28089): stderr: | 20221213134848713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134848713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134848713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134848713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134848713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134848713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134848726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134848734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134848734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134848734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:51.703611 run osmo-msc_10.42.42.6(pid=28095): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28095)] 13:48:51.753115 run osmo-msc_10.42.42.6(pid=28095): stdout: | (launched: 2022-12-13_13:48:50.556559) 13:48:51.804310 run osmo-msc_10.42.42.6(pid=28095): stderr: | 20221213134850880 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134850880 DLGLOBAL DEBUG validating counter group 0x7f454c8d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134850880 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134850880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134850880 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134850880 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134850882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134850882 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134850883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134850883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:51.856071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28088): Terminating (SIGTERM) 13:48:51.897662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28091): Terminating (SIGTERM) 13:48:51.939834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28094): Terminating (SIGTERM) 13:48:51.981684 --- ParallelTerminationStrategy: PID 28088 died... 13:48:52.001839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28088): Terminated: ok {rc=0} 13:48:52.047809 --- ParallelTerminationStrategy: PID 28091 died... 13:48:52.067503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28091): Terminated: ok {rc=0} 13:48:52.113327 --- ParallelTerminationStrategy: PID 28094 died... 13:48:52.133030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28094): Terminated: ok {rc=0} 13:48:52.220797 bus /sierra_3: Setting Powered False 13:48:53.318661 bus /sierra_3: Setting Powered False 13:48:54.432537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:48:55.683565 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:55.689808 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:48:55.724127 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:48:55.752310 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:48:55.805491 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:48:55.839245 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:48:55.866764 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:48:56.414522 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:48:56.463829 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:56.474934 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:48:56.544559 tst mo_mt_call.py: using LAC 34367 13:48:56.672325 tst mo_mt_call.py: using RAC 197 13:48:56.798378 tst mo_mt_call.py: using CellId 34367 13:48:56.926123 tst mo_mt_call.py: using BVCI 34368 13:48:57.045596 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:57.056853 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:57.068035 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:57.079149 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:57.090574 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:57.102154 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:57.221513 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:57.341769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:57.842117 run create_hlr_db(pid=28100): Launched 13:48:57.966551 bus /sierra_2: Setting Powered False 13:48:59.030362 run create_hlr_db(pid=28100): Terminated: ok {rc=0} 13:48:59.479664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Launched 13:48:59.804230 run osmo-hlr_10.42.42.2(pid=28103): Launched 13:48:59.927527 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:00.486176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Launched 13:49:00.809275 run osmo-stp_10.42.42.5(pid=28106): Launched 13:49:01.033328 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:01.753661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Launched 13:49:02.081767 run osmo-msc_10.42.42.6(pid=28109): Launched 13:49:02.346600 run osmo-stp_10.42.42.5(pid=28106): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] 13:49:02.483785 run osmo-stp_10.42.42.5(pid=28106): stdout: | (launched: 2022-12-13_13:49:00.749942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:02.623875 run osmo-stp_10.42.42.5(pid=28106): stderr: | 20221213134901024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134901024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134901024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134901025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134901025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134901025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134901025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:02.759803 run osmo-stp_10.42.42.5(pid=28106): stdout: | (launched: 2022-12-13_13:49:00.749942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:02.888248 run osmo-stp_10.42.42.5(pid=28106): stderr: | 20221213134901024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134901024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134901024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134901025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134901025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134901025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134901025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:03.042010 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28106): Process ended prematurely: osmo-stp_10.42.42.5(pid=28106) [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:49:03.051672 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:49:03.079172 run osmo-hlr_10.42.42.2(pid=28103): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28103)] 13:49:03.129254 run osmo-hlr_10.42.42.2(pid=28103): stdout: | (launched: 2022-12-13_13:48:59.745247) 13:49:03.180783 run osmo-hlr_10.42.42.2(pid=28103): stderr: | 20221213134859943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134859943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134859943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134859943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134859944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134859944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134859960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134859970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134859970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134859970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:03.252321 run osmo-msc_10.42.42.6(pid=28109): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28109)] 13:49:03.301605 run osmo-msc_10.42.42.6(pid=28109): stdout: | (launched: 2022-12-13_13:49:02.022995) 13:49:03.352836 run osmo-msc_10.42.42.6(pid=28109): stderr: | 20221213134902448 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134902448 DLGLOBAL DEBUG validating counter group 0x7f47d4af8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134902449 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134902449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134902449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134902449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134902451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134902451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134902451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134902451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:03.404586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Terminating (SIGTERM) 13:49:03.446041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Terminating (SIGTERM) 13:49:03.488145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Terminating (SIGTERM) 13:49:03.530265 --- ParallelTerminationStrategy: PID 28102 died... 13:49:03.550628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Terminated: ok {rc=0} 13:49:03.596424 --- ParallelTerminationStrategy: PID 28105 died... 13:49:03.615993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Terminated: ok {rc=0} 13:49:03.661788 --- ParallelTerminationStrategy: PID 28108 died... 13:49:03.681626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Terminated: ok {rc=0} 13:49:03.769897 bus /sierra_3: Setting Powered False 13:49:04.867676 bus /sierra_3: Setting Powered False 13:49:05.984459 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:49:07.134137 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.146359 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:49:07.219744 tst mo_mt_call_osmux.py: using LAC 34368 13:49:07.349159 tst mo_mt_call_osmux.py: using RAC 198 13:49:07.475531 tst mo_mt_call_osmux.py: using CellId 34368 13:49:07.603720 tst mo_mt_call_osmux.py: using BVCI 34369 13:49:07.721940 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.733319 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.744348 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.755474 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.767134 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:49:07.778667 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:49:07.895691 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:49:08.015575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:08.518490 run create_hlr_db(pid=28111): Launched 13:49:08.643472 bus /sierra_2: Setting Powered False 13:49:09.706965 run create_hlr_db(pid=28111): Terminated: ok {rc=0} 13:49:10.157532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28113): Launched 13:49:10.483592 run osmo-hlr_10.42.42.2(pid=28114): Launched 13:49:10.608144 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:11.166118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28116): Launched 13:49:11.490255 run osmo-stp_10.42.42.5(pid=28117): Launched 13:49:11.615454 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:12.201931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28119): Launched 13:49:12.529161 run osmo-msc_10.42.42.6(pid=28120): Launched 13:49:12.712150 run osmo-stp_10.42.42.5(pid=28117): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28117)] 13:49:12.849586 run osmo-stp_10.42.42.5(pid=28117): stdout: | (launched: 2022-12-13_13:49:11.430695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:12.988292 run osmo-stp_10.42.42.5(pid=28117): stderr: | 20221213134911620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134911620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134911620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134911621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134911621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134911621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134911621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:13.124502 run osmo-stp_10.42.42.5(pid=28117): stdout: | (launched: 2022-12-13_13:49:11.430695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:13.253537 run osmo-stp_10.42.42.5(pid=28117): stderr: | 20221213134911620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134911620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134911620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134911621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134911621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134911621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134911621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:13.407948 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28117): Process ended prematurely: osmo-stp_10.42.42.5(pid=28117) [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28117)] [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:49:13.417808 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:49:13.446122 run osmo-hlr_10.42.42.2(pid=28114): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28114)] 13:49:13.497865 run osmo-hlr_10.42.42.2(pid=28114): stdout: | (launched: 2022-12-13_13:49:10.423854) 13:49:13.550506 run osmo-hlr_10.42.42.2(pid=28114): stderr: | 20221213134910623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134910623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134910623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134910623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134910623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134910623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134910634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134910643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134910643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134910643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:13.623582 run osmo-msc_10.42.42.6(pid=28120): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28120)] 13:49:13.674248 run osmo-msc_10.42.42.6(pid=28120): stdout: | (launched: 2022-12-13_13:49:12.468491) 13:49:13.726753 run osmo-msc_10.42.42.6(pid=28120): stderr: | 20221213134912790 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134912790 DLGLOBAL DEBUG validating counter group 0x7f709d884c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134912790 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134912790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134912791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134912791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134912793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134912793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134912793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134912793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:13.779903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28113): Terminating (SIGTERM) 13:49:13.822185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28116): Terminating (SIGTERM) 13:49:13.864318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28119): Terminating (SIGTERM) 13:49:13.906685 --- ParallelTerminationStrategy: PID 28113 died... 13:49:13.927255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28113): Terminated: ok {rc=0} 13:49:13.973757 --- ParallelTerminationStrategy: PID 28116 died... 13:49:13.993878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28116): Terminated: ok {rc=0} 13:49:14.040700 --- ParallelTerminationStrategy: PID 28119 died... 13:49:14.061062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28119): Terminated: ok {rc=0} 13:49:14.151153 bus /sierra_3: Setting Powered False 13:49:15.249801 bus /sierra_3: Setting Powered False 13:49:16.368017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:trx-lms --------------------------------------------------------------------- 13:49:17.621350 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:17.626264 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 13:49:17.659702 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:49:17.687644 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 13:49:17.774281 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 13:49:17.808357 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:49:17.835993 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 13:49:18.420225 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 13:49:18.425619 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:18.436534 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:49:18.487542 tst emergency_mo_mt_call.py: using LAC 34369 13:49:18.614487 tst emergency_mo_mt_call.py: using RAC 199 13:49:18.741482 tst emergency_mo_mt_call.py: using CellId 34369 13:49:18.865365 tst emergency_mo_mt_call.py: using BVCI 34370 13:49:18.980130 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:18.991293 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:19.002277 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:19.013803 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:19.024852 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:19.036177 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:19.150896 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:19.274502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:19.768656 run create_hlr_db(pid=28125): Launched 13:49:19.888586 bus /sierra_2: Setting Powered False 13:49:20.951325 run create_hlr_db(pid=28125): Terminated: ok {rc=0} 13:49:21.393111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Launched 13:49:21.710289 run osmo-hlr_10.42.42.2(pid=28128): Launched 13:49:21.830384 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:22.382448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Launched 13:49:22.699975 run osmo-stp_10.42.42.5(pid=28131): Launched 13:49:22.828660 tst emergency_mo_mt_call.py: using MSISDN 8185 13:49:22.991492 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:23.564456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Launched 13:49:23.882817 run osmo-msc_10.42.42.6(pid=28134): Launched 13:49:24.060626 run osmo-stp_10.42.42.5(pid=28131): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] 13:49:24.195907 run osmo-stp_10.42.42.5(pid=28131): stdout: | (launched: 2022-12-13_13:49:22.641612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:24.331895 run osmo-stp_10.42.42.5(pid=28131): stderr: | 20221213134922833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134922833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134922833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134922834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134922834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134922834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134922834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:24.466567 run osmo-stp_10.42.42.5(pid=28131): stdout: | (launched: 2022-12-13_13:49:22.641612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:24.593983 run osmo-stp_10.42.42.5(pid=28131): stderr: | 20221213134922833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134922833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134922833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134922834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134922834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134922834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134922834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:24.745596 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28131): Process ended prematurely: osmo-stp_10.42.42.5(pid=28131) [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 13:49:24.754704 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:49:24.782250 run osmo-hlr_10.42.42.2(pid=28128): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28128)] 13:49:24.832443 run osmo-hlr_10.42.42.2(pid=28128): stdout: | (launched: 2022-12-13_13:49:21.652053) 13:49:24.884713 run osmo-hlr_10.42.42.2(pid=28128): stderr: | 20221213134921847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134921847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134921847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134921847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134921847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134921847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134921858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134921866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134921866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134921866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:24.956490 run osmo-msc_10.42.42.6(pid=28134): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28134)] 13:49:25.006047 run osmo-msc_10.42.42.6(pid=28134): stdout: | (launched: 2022-12-13_13:49:23.824028) 13:49:25.057975 run osmo-msc_10.42.42.6(pid=28134): stderr: | 20221213134924142 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134924142 DLGLOBAL DEBUG validating counter group 0x7f50023d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134924142 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134924142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134924143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134924143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134924144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134924145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134924145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134924145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:25.109479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Terminating (SIGTERM) 13:49:25.151547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Terminating (SIGTERM) 13:49:25.193631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Terminating (SIGTERM) 13:49:25.235965 --- ParallelTerminationStrategy: PID 28127 died... 13:49:25.256397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Terminated: ok {rc=0} 13:49:25.302696 --- ParallelTerminationStrategy: PID 28130 died... 13:49:25.322518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Terminated: ok {rc=0} 13:49:25.368514 --- ParallelTerminationStrategy: PID 28133 died... 13:49:25.388465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Terminated: ok {rc=0} 13:49:25.476023 bus /sierra_3: Setting Powered False 13:49:26.574934 bus /sierra_3: Setting Powered False 13:49:27.689784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 13:49:28.775900 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:28.787233 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:49:28.837830 tst emergency_preemptive_call.py: using LAC 34370 13:49:28.955976 tst emergency_preemptive_call.py: using RAC 200 13:49:29.074282 tst emergency_preemptive_call.py: using CellId 34370 13:49:29.193446 tst emergency_preemptive_call.py: using BVCI 34371 13:49:29.309539 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:29.320726 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:29.331807 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:29.342967 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:29.354430 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:49:29.365653 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:29.481407 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:29.601154 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:29.716196 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:49:29.834821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:30.326987 run create_hlr_db(pid=28136): Launched 13:49:30.448355 bus /sierra_2: Setting Powered False 13:49:31.510631 run create_hlr_db(pid=28136): Terminated: ok {rc=0} 13:49:31.961977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28138): Launched 13:49:32.287922 run osmo-hlr_10.42.42.2(pid=28139): Launched 13:49:32.410193 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:32.960841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28141): Launched 13:49:33.278531 run osmo-stp_10.42.42.5(pid=28142): Launched 13:49:33.410855 tst emergency_preemptive_call.py: using MSISDN 8186 13:49:33.579054 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:34.148291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28144): Launched 13:49:34.465198 run osmo-msc_10.42.42.6(pid=28145): Launched 13:49:34.642430 run osmo-stp_10.42.42.5(pid=28142): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28142)] 13:49:34.775950 run osmo-stp_10.42.42.5(pid=28142): stdout: | (launched: 2022-12-13_13:49:33.219887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:34.911247 run osmo-stp_10.42.42.5(pid=28142): stderr: | 20221213134933410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134933410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134933411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134933411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134933411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134933412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134933412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:35.045571 run osmo-stp_10.42.42.5(pid=28142): stdout: | (launched: 2022-12-13_13:49:33.219887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:35.171385 run osmo-stp_10.42.42.5(pid=28142): stderr: | 20221213134933410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134933410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134933411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134933411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134933411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134933412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134933412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:35.322213 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28142): Process ended prematurely: osmo-stp_10.42.42.5(pid=28142) [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28142)] [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py:32] 13:49:35.331122 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 13:49:35.358588 run osmo-hlr_10.42.42.2(pid=28139): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28139)] 13:49:35.409756 run osmo-hlr_10.42.42.2(pid=28139): stdout: | (launched: 2022-12-13_13:49:32.229482) 13:49:35.461815 run osmo-hlr_10.42.42.2(pid=28139): stderr: | 20221213134932423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134932423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134932423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134932423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134932423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134932423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134932435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134932444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134932444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134932444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:35.534597 run osmo-msc_10.42.42.6(pid=28145): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28145)] 13:49:35.584683 run osmo-msc_10.42.42.6(pid=28145): stdout: | (launched: 2022-12-13_13:49:34.406795) 13:49:35.636768 run osmo-msc_10.42.42.6(pid=28145): stderr: | 20221213134934728 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213134934728 DLGLOBAL DEBUG validating counter group 0x7fcbb8299c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213134934728 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213134934728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213134934729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213134934729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213134934731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213134934731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213134934731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213134934731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:35.689481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28138): Terminating (SIGTERM) 13:49:35.731174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28141): Terminating (SIGTERM) 13:49:35.773931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28144): Terminating (SIGTERM) 13:49:35.816704 --- ParallelTerminationStrategy: PID 28138 died... 13:49:35.837402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28138): Terminated: ok {rc=0} 13:49:35.884013 --- ParallelTerminationStrategy: PID 28141 died... 13:49:35.904156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28141): Terminated: ok {rc=0} 13:49:35.951433 --- ParallelTerminationStrategy: PID 28144 died... 13:49:35.971512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28144): Terminated: ok {rc=0} 13:49:36.061778 bus /sierra_9: Setting Powered False 13:49:37.158084 bus /sierra_9: Setting Powered False 13:49:38.274328 bus /sierra_8: Setting Powered False 13:49:39.371320 bus /sierra_8: Setting Powered False 13:49:40.486228 bus /sierra_3: Setting Powered False 13:49:41.585935 bus /sierra_3: Setting Powered False 13:49:42.703067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms --------------------------------------------------------------------- 13:49:43.982906 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:43.987674 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 13:49:44.021361 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 13:49:44.061668 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 13:49:44.150638 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 13:49:44.184203 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 13:49:44.223904 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 13:49:44.811087 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 13:49:44.860577 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:44.871241 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:49:44.919869 tst cs_paging_gprs_active.py: using LAC 34371 13:49:45.039581 tst cs_paging_gprs_active.py: using RAC 201 13:49:45.160325 tst cs_paging_gprs_active.py: using CellId 34371 13:49:45.281144 tst cs_paging_gprs_active.py: using BVCI 34372 13:49:45.391524 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.402150 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.412396 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.422772 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.433069 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.443924 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.454996 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.465468 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:45.475989 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:49:45.596730 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:49:45.713550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:49:45.926487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:46.236577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28151): Launched 13:49:46.520232 run iperf3-srv_10.42.42.10(pid=28152): Launched 13:49:46.659841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:49:46.885997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:47.222214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28153): Launched 13:49:47.504771 run iperf3-srv_10.42.42.10(pid=28154): Launched 13:49:47.626804 tst cs_paging_gprs_active.py:38: start network... 13:49:47.844649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:48.345967 run create_hlr_db(pid=28155): Launched 13:49:48.471233 bus /sierra_2: Setting Powered False 13:49:49.535407 run create_hlr_db(pid=28155): Terminated: ok {rc=0} 13:49:49.968382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Launched 13:49:50.270927 run osmo-hlr_10.42.42.2(pid=28158): Launched 13:49:50.385522 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:50.908665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Launched 13:49:51.211626 run osmo-stp_10.42.42.5(pid=28161): Launched 13:49:51.327061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:51.847694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28163): Launched 13:49:51.963076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:52.217540 run patchelf(pid=28164): Launched 13:49:52.386344 run osmo-stp_10.42.42.5(pid=28161): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] 13:49:52.514431 run osmo-stp_10.42.42.5(pid=28161): stdout: | (launched: 2022-12-13_13:49:51.155848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:52.643915 run osmo-stp_10.42.42.5(pid=28161): stderr: | 20221213134951326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134951326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134951326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134951327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134951327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134951327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134951327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:52.773972 run osmo-stp_10.42.42.5(pid=28161): stdout: | (launched: 2022-12-13_13:49:51.155848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:52.897668 run osmo-stp_10.42.42.5(pid=28161): stderr: | 20221213134951326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213134951326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213134951326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213134951327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213134951327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213134951327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213134951327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:53.044340 run patchelf(pid=28164): Terminating (SIGINT) 13:49:53.214464 run patchelf(pid=28164): Terminated: ok {rc=0} 13:49:53.337858 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28161): Process ended prematurely: osmo-stp_10.42.42.5(pid=28161) [trial-2390↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] [trial-2390↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 13:49:53.347284 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:49:53.374125 run osmo-hlr_10.42.42.2(pid=28158): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28158)] 13:49:53.421105 run osmo-hlr_10.42.42.2(pid=28158): stdout: | (launched: 2022-12-13_13:49:50.215062) 13:49:53.469445 run osmo-hlr_10.42.42.2(pid=28158): stderr: | 20221213134950391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213134950391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213134950391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213134950391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213134950391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213134950391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213134950403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213134950414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213134950414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213134950414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:53.518544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28151): Terminating (SIGTERM) 13:49:53.558276 run iperf3-srv_10.42.42.10(pid=28152): Terminating (SIGTERM) 13:49:53.597456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28153): Terminating (SIGTERM) 13:49:53.637058 run iperf3-srv_10.42.42.10(pid=28154): Terminating (SIGTERM) 13:49:53.676336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Terminating (SIGTERM) 13:49:53.715674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Terminating (SIGTERM) 13:49:53.755068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28163): Terminating (SIGTERM) 13:49:53.794640 --- ParallelTerminationStrategy: PID 28151 died... 13:49:53.813752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28151): Terminated: ok {rc=0} 13:49:53.857224 --- ParallelTerminationStrategy: PID 28152 died... 13:49:53.875792 run iperf3-srv_10.42.42.10(pid=28152): Terminated {rc=256} 13:49:53.919033 --- ParallelTerminationStrategy: PID 28153 died... 13:49:53.937706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28153): Terminated: ok {rc=0} 13:49:53.980662 --- ParallelTerminationStrategy: PID 28154 died... 13:49:53.998905 run iperf3-srv_10.42.42.10(pid=28154): Terminated {rc=256} 13:49:54.042082 --- ParallelTerminationStrategy: PID 28157 died... 13:49:54.060578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Terminated: ok {rc=0} 13:49:54.103931 --- ParallelTerminationStrategy: PID 28160 died... 13:49:54.122438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Terminated: ok {rc=0} 13:49:54.165806 --- ParallelTerminationStrategy: PID 28163 died... 13:49:54.184351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28163): Terminated: ok {rc=0} 13:49:54.269090 bus /gobi_0: Setting Powered False 13:49:55.368096 bus /gobi_0: Setting Powered False 13:49:56.481705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms iperf3.py ---------------------------------------------- 13:49:57.630366 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:57.641959 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:49:57.695196 tst iperf3.py: using LAC 34372 13:49:57.825452 tst iperf3.py: using RAC 202 13:49:57.951124 tst iperf3.py: using CellId 34372 13:49:58.078233 tst iperf3.py: using BVCI 34373 13:49:58.196002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.207120 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.218124 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.228813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.239880 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.251014 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.262243 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.273384 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:49:58.284594 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:49:58.401554 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:49:58.604425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:58.907064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28165): Launched 13:49:59.170816 run iperf3-srv_10.42.42.10(pid=28166): Launched 13:49:59.286223 tst iperf3.py:8: start network... 13:49:59.487403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:59.955568 run create_hlr_db(pid=28167): Launched 13:50:00.080378 bus /gobi_6: Setting Powered False 13:50:01.157834 run create_hlr_db(pid=28167): Terminated: ok {rc=0} 13:50:01.610077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Launched 13:50:01.939048 run osmo-hlr_10.42.42.2(pid=28173): Launched 13:50:02.146643 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:02.737591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Launched 13:50:03.042858 run osmo-stp_10.42.42.5(pid=28176): Launched 13:50:03.157058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:03.677640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Launched 13:50:03.793446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:04.053712 run patchelf(pid=28179): Launched 13:50:04.235189 run osmo-stp_10.42.42.5(pid=28176): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28176)] 13:50:04.373293 run osmo-stp_10.42.42.5(pid=28176): stdout: | (launched: 2022-12-13_13:50:02.986473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:04.513031 run osmo-stp_10.42.42.5(pid=28176): stderr: | 20221213135003155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135003156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135003156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135003156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135003157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135003157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135003157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:04.653427 run osmo-stp_10.42.42.5(pid=28176): stdout: | (launched: 2022-12-13_13:50:02.986473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:04.787239 run osmo-stp_10.42.42.5(pid=28176): stderr: | 20221213135003155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135003156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135003156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135003156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135003157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135003157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135003157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:04.945621 run patchelf(pid=28179): Terminating (SIGINT) 13:50:05.128391 run patchelf(pid=28179): Terminated: ok {rc=0} 13:50:05.260516 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28176): Process ended prematurely: osmo-stp_10.42.42.5(pid=28176) [trial-2390↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28176)] [trial-2390↪gprs:trx-lms↪iperf3.py:8] 13:50:05.270844 tst iperf3.py:8: Test FAILED (7.7 sec) 13:50:05.299314 run osmo-hlr_10.42.42.2(pid=28173): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28173)] 13:50:05.350092 run osmo-hlr_10.42.42.2(pid=28173): stdout: | (launched: 2022-12-13_13:50:01.880268) 13:50:05.402185 run osmo-hlr_10.42.42.2(pid=28173): stderr: | 20221213135002192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135002192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135002192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135002192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135002192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135002192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135002215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135002231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135002231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135002231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:05.454495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28165): Terminating (SIGTERM) 13:50:05.496445 run iperf3-srv_10.42.42.10(pid=28166): Terminating (SIGTERM) 13:50:05.538831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Terminating (SIGTERM) 13:50:05.581272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Terminating (SIGTERM) 13:50:05.623363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Terminating (SIGTERM) 13:50:05.665822 --- ParallelTerminationStrategy: PID 28165 died... 13:50:05.686579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28165): Terminated: ok {rc=0} 13:50:05.733315 --- ParallelTerminationStrategy: PID 28166 died... 13:50:05.753382 run iperf3-srv_10.42.42.10(pid=28166): Terminated {rc=256} 13:50:05.799749 --- ParallelTerminationStrategy: PID 28172 died... 13:50:05.819913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28172): Terminated: ok {rc=0} 13:50:05.866316 --- ParallelTerminationStrategy: PID 28175 died... 13:50:05.886446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28175): Terminated: ok {rc=0} 13:50:05.932738 --- ParallelTerminationStrategy: PID 28178 died... 13:50:05.952922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28178): Terminated: ok {rc=0} 13:50:06.041018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms iperf3m4.py ---------------------------------------------- 13:50:07.186207 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.197227 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:50:07.254604 tst iperf3m4.py: using LAC 34373 13:50:07.372890 tst iperf3m4.py: using RAC 203 13:50:07.490394 tst iperf3m4.py: using CellId 34373 13:50:07.607546 tst iperf3m4.py: using BVCI 34374 13:50:07.717694 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.728169 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.738486 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.748724 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.758932 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.769319 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.779649 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.789982 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:07.800325 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:07.915632 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:08.042660 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:08.161016 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:08.278789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:08.480057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:08.781395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Launched 13:50:09.045584 run iperf3-srv_10.42.42.10(pid=28181): Launched 13:50:09.159251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:50:09.362488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:09.666881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Launched 13:50:09.930409 run iperf3-srv_10.42.42.10(pid=28183): Launched 13:50:10.045631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:50:10.246421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:10.548707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Launched 13:50:10.810972 run iperf3-srv_10.42.42.10(pid=28185): Launched 13:50:10.923953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:50:11.124825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:11.427533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Launched 13:50:11.690219 run iperf3-srv_10.42.42.10(pid=28187): Launched 13:50:11.805582 tst iperf3m4.py:8: start network... 13:50:12.006286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:12.473204 run create_hlr_db(pid=28188): Launched 13:50:12.596878 bus /gobi_6: Setting Powered False 13:50:13.657334 run create_hlr_db(pid=28188): Terminated: ok {rc=0} 13:50:14.098767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28190): Launched 13:50:14.422972 run osmo-hlr_10.42.42.2(pid=28191): Launched 13:50:14.548502 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:15.109143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28193): Launched 13:50:15.433441 run osmo-stp_10.42.42.5(pid=28194): Launched 13:50:15.559893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:16.137752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28196): Launched 13:50:16.266465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:16.534517 run patchelf(pid=28197): Launched 13:50:16.723261 run osmo-stp_10.42.42.5(pid=28194): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28194)] 13:50:16.861295 run osmo-stp_10.42.42.5(pid=28194): stdout: | (launched: 2022-12-13_13:50:15.373882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:17.003007 run osmo-stp_10.42.42.5(pid=28194): stderr: | 20221213135015566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135015566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135015566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135015567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135015567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135015567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135015567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:17.145872 run osmo-stp_10.42.42.5(pid=28194): stdout: | (launched: 2022-12-13_13:50:15.373882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:17.280834 run osmo-stp_10.42.42.5(pid=28194): stderr: | 20221213135015566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135015566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135015566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135015567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135015567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135015567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135015567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:17.438185 run patchelf(pid=28197): Terminating (SIGINT) 13:50:17.621266 run patchelf(pid=28197): Terminated: ok {rc=0} 13:50:17.752150 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28194): Process ended prematurely: osmo-stp_10.42.42.5(pid=28194) [trial-2390↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28194)] [trial-2390↪gprs:trx-lms↪iperf3m4.py:8] 13:50:17.762730 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:50:17.791449 run osmo-hlr_10.42.42.2(pid=28191): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28191)] 13:50:17.842515 run osmo-hlr_10.42.42.2(pid=28191): stdout: | (launched: 2022-12-13_13:50:14.363531) 13:50:17.894238 run osmo-hlr_10.42.42.2(pid=28191): stderr: | 20221213135014561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135014561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135014561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135014561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135014561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135014561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135014574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135014583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135014583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135014583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:17.946385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Terminating (SIGTERM) 13:50:17.988436 run iperf3-srv_10.42.42.10(pid=28181): Terminating (SIGTERM) 13:50:18.030790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Terminating (SIGTERM) 13:50:18.072856 run iperf3-srv_10.42.42.10(pid=28183): Terminating (SIGTERM) 13:50:18.114796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Terminating (SIGTERM) 13:50:18.156668 run iperf3-srv_10.42.42.10(pid=28185): Terminating (SIGTERM) 13:50:18.198570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Terminating (SIGTERM) 13:50:18.240444 run iperf3-srv_10.42.42.10(pid=28187): Terminating (SIGTERM) 13:50:18.282114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28190): Terminating (SIGTERM) 13:50:18.324069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28193): Terminating (SIGTERM) 13:50:18.366004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28196): Terminating (SIGTERM) 13:50:18.408177 --- ParallelTerminationStrategy: PID 28180 died... 13:50:18.428205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28180): Terminated: ok {rc=0} 13:50:18.474866 --- ParallelTerminationStrategy: PID 28181 died... 13:50:18.494835 run iperf3-srv_10.42.42.10(pid=28181): Terminated {rc=256} 13:50:18.541168 --- ParallelTerminationStrategy: PID 28182 died... 13:50:18.561072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Terminated: ok {rc=0} 13:50:18.607358 --- ParallelTerminationStrategy: PID 28183 died... 13:50:18.627011 run iperf3-srv_10.42.42.10(pid=28183): Terminated {rc=256} 13:50:18.673323 --- ParallelTerminationStrategy: PID 28184 died... 13:50:18.693317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Terminated: ok {rc=0} 13:50:18.739622 --- ParallelTerminationStrategy: PID 28185 died... 13:50:18.759334 run iperf3-srv_10.42.42.10(pid=28185): Terminated {rc=256} 13:50:18.805140 --- ParallelTerminationStrategy: PID 28186 died... 13:50:18.824868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Terminated: ok {rc=0} 13:50:18.871326 --- ParallelTerminationStrategy: PID 28187 died... 13:50:18.891211 run iperf3-srv_10.42.42.10(pid=28187): Terminated {rc=256} 13:50:18.937539 --- ParallelTerminationStrategy: PID 28190 died... 13:50:18.957625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28190): Terminated: ok {rc=0} 13:50:19.003842 --- ParallelTerminationStrategy: PID 28193 died... 13:50:19.023794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28193): Terminated: ok {rc=0} 13:50:19.070138 --- ParallelTerminationStrategy: PID 28196 died... 13:50:19.090214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28196): Terminated: ok {rc=0} 13:50:19.178130 bus /gobi_4: Setting Powered False 13:50:20.275574 bus /gobi_4: Setting Powered False 13:50:21.390749 bus /gobi_1: Setting Powered False 13:50:22.487560 bus /gobi_1: Setting Powered False 13:50:23.602243 bus /gobi_0: Setting Powered False 13:50:24.700286 bus /gobi_0: Setting Powered False 13:50:25.817114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms ping.py ---------------------------------------------- 13:50:26.918139 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:26.929617 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:50:26.979778 tst ping.py: using LAC 34374 13:50:27.097548 tst ping.py: using RAC 204 13:50:27.224011 tst ping.py: using CellId 34374 13:50:27.342403 tst ping.py: using BVCI 34375 13:50:27.449975 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.460502 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.471043 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.481595 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.492323 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.502868 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.513504 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:27.523990 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:27.642044 tst ping.py:19: start network... 13:50:27.855616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:28.346551 run create_hlr_db(pid=28198): Launched 13:50:28.467541 bus /gobi_6: Setting Powered False 13:50:29.530120 run create_hlr_db(pid=28198): Terminated: ok {rc=0} 13:50:29.954061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28200): Launched 13:50:30.249700 run osmo-hlr_10.42.42.2(pid=28201): Launched 13:50:30.361659 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:30.898833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28203): Launched 13:50:31.239966 run osmo-stp_10.42.42.5(pid=28204): Launched 13:50:31.608230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:32.282146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28206): Launched 13:50:32.408551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:32.661026 run patchelf(pid=28207): Launched 13:50:32.828166 run osmo-stp_10.42.42.5(pid=28204): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28204)] 13:50:32.953308 run osmo-stp_10.42.42.5(pid=28204): stdout: | (launched: 2022-12-13_13:50:31.180569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:33.080535 run osmo-stp_10.42.42.5(pid=28204): stderr: | 20221213135031511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135031512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135031512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135031512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135031513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135031513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135031513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:33.207736 run osmo-stp_10.42.42.5(pid=28204): stdout: | (launched: 2022-12-13_13:50:31.180569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:33.328498 run osmo-stp_10.42.42.5(pid=28204): stderr: | 20221213135031511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135031512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135031512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135031512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135031513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135031513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135031513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:33.472593 run patchelf(pid=28207): Terminating (SIGINT) 13:50:33.638962 run patchelf(pid=28207): Terminated: ok {rc=0} 13:50:33.759268 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28204): Process ended prematurely: osmo-stp_10.42.42.5(pid=28204) [trial-2390↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28204)] [trial-2390↪gprs:trx-lms↪ping.py:22] 13:50:33.768299 tst ping.py:22: Test FAILED (6.8 sec) 13:50:33.794792 run osmo-hlr_10.42.42.2(pid=28201): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28201)] 13:50:33.841638 run osmo-hlr_10.42.42.2(pid=28201): stdout: | (launched: 2022-12-13_13:50:30.195122) 13:50:33.890166 run osmo-hlr_10.42.42.2(pid=28201): stderr: | 20221213135030370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135030370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135030370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135030370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135030370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135030370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135030382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135030391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135030391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135030391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:33.938814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28200): Terminating (SIGTERM) 13:50:33.978009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28203): Terminating (SIGTERM) 13:50:34.017451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28206): Terminating (SIGTERM) 13:50:34.057121 --- ParallelTerminationStrategy: PID 28200 died... 13:50:34.076252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28200): Terminated: ok {rc=0} 13:50:34.119820 --- ParallelTerminationStrategy: PID 28203 died... 13:50:34.138371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28203): Terminated: ok {rc=0} 13:50:34.181425 --- ParallelTerminationStrategy: PID 28206 died... 13:50:34.199879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28206): Terminated: ok {rc=0} 13:50:34.284105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 13:50:35.372307 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.387666 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:50:35.435791 tst ping_idle_ping.py: using LAC 34375 13:50:35.553862 tst ping_idle_ping.py: using RAC 205 13:50:35.670981 tst ping_idle_ping.py: using CellId 34375 13:50:35.789276 tst ping_idle_ping.py: using BVCI 34376 13:50:35.896209 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.907000 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.917645 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.928092 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.938448 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.949298 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.959871 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:50:35.970547 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:50:36.088547 tst ping_idle_ping.py:24: start network... 13:50:36.288479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:36.752041 run create_hlr_db(pid=28208): Launched 13:50:36.873493 bus /gobi_6: Setting Powered False 13:50:37.933533 run create_hlr_db(pid=28208): Terminated: ok {rc=0} 13:50:38.350106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Launched 13:50:38.648574 run osmo-hlr_10.42.42.2(pid=28211): Launched 13:50:38.762315 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:39.274229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Launched 13:50:39.571993 run osmo-stp_10.42.42.5(pid=28214): Launched 13:50:39.684847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:40.196439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Launched 13:50:40.309816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:40.560422 run patchelf(pid=28217): Launched 13:50:40.725718 run osmo-stp_10.42.42.5(pid=28214): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] 13:50:40.851052 run osmo-stp_10.42.42.5(pid=28214): stdout: | (launched: 2022-12-13_13:50:39.516742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:40.978297 run osmo-stp_10.42.42.5(pid=28214): stderr: | 20221213135039687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135039688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135039688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135039688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135039689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135039689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135039689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:41.105778 run osmo-stp_10.42.42.5(pid=28214): stdout: | (launched: 2022-12-13_13:50:39.516742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:41.227146 run osmo-stp_10.42.42.5(pid=28214): stderr: | 20221213135039687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135039688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135039688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135039688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135039689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135039689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135039689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:41.370883 run patchelf(pid=28217): Terminating (SIGINT) 13:50:41.538134 run patchelf(pid=28217): Terminated: ok {rc=0} 13:50:41.658608 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28214): Process ended prematurely: osmo-stp_10.42.42.5(pid=28214) [trial-2390↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] [trial-2390↪gprs:trx-lms↪ping_idle_ping.py:27] 13:50:41.667586 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:50:41.693981 run osmo-hlr_10.42.42.2(pid=28211): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28211)] 13:50:41.740627 run osmo-hlr_10.42.42.2(pid=28211): stdout: | (launched: 2022-12-13_13:50:38.593129) 13:50:41.789243 run osmo-hlr_10.42.42.2(pid=28211): stderr: | 20221213135038766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135038766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135038766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135038766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135038767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135038767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135038779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135038788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135038788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135038788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:41.837870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Terminating (SIGTERM) 13:50:41.876911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Terminating (SIGTERM) 13:50:41.916903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Terminating (SIGTERM) 13:50:41.957336 --- ParallelTerminationStrategy: PID 28210 died... 13:50:41.976011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Terminated: ok {rc=0} 13:50:42.019658 --- ParallelTerminationStrategy: PID 28213 died... 13:50:42.038118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Terminated: ok {rc=0} 13:50:42.081319 --- ParallelTerminationStrategy: PID 28216 died... 13:50:42.099807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Terminated: ok {rc=0} 13:50:42.182130 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 13:50:43.475772 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:50:43.481070 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:50:43.514171 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:50:43.552682 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:50:43.638495 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:50:43.671163 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:50:43.709437 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:50:44.309451 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:50:44.362812 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.374364 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:44.426703 tst cs_paging_gprs_active.py: using LAC 34376 13:50:44.555583 tst cs_paging_gprs_active.py: using RAC 206 13:50:44.682775 tst cs_paging_gprs_active.py: using CellId 34376 13:50:44.812421 tst cs_paging_gprs_active.py: using BVCI 34377 13:50:44.932410 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.943820 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.954974 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.966241 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.977689 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.989173 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:45.000862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:45.012367 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:45.024353 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:45.141939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:45.263890 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:50:45.483892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:45.812305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28221): Launched 13:50:46.136934 run iperf3-srv_10.42.42.10(pid=28222): Launched 13:50:46.271478 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:50:46.495005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:46.852603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28223): Launched 13:50:47.205401 run iperf3-srv_10.42.42.10(pid=28224): Launched 13:50:47.334339 tst cs_paging_gprs_active.py:38: start network... 13:50:47.536502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:48.006309 run create_hlr_db(pid=28225): Launched 13:50:48.132811 bus /gobi_6: Setting Powered False 13:50:49.193086 run create_hlr_db(pid=28225): Terminated: ok {rc=0} 13:50:49.635570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Launched 13:50:49.960472 run osmo-hlr_10.42.42.2(pid=28228): Launched 13:50:50.086032 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:50.641877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Launched 13:50:50.966785 run osmo-stp_10.42.42.5(pid=28231): Launched 13:50:51.091043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:51.651288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28233): Launched 13:50:51.777912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:52.055586 run patchelf(pid=28240): Launched 13:50:52.238557 run osmo-stp_10.42.42.5(pid=28231): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] 13:50:52.375634 run osmo-stp_10.42.42.5(pid=28231): stdout: | (launched: 2022-12-13_13:50:50.907227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:52.514646 run osmo-stp_10.42.42.5(pid=28231): stderr: | 20221213135051098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135051098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135051098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135051099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135051099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135051099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135051099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:52.653974 run osmo-stp_10.42.42.5(pid=28231): stdout: | (launched: 2022-12-13_13:50:50.907227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:52.787076 run osmo-stp_10.42.42.5(pid=28231): stderr: | 20221213135051098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135051098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135051098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135051099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135051099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135051099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135051099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:52.944371 run patchelf(pid=28240): Terminating (SIGINT) 13:50:53.126620 run patchelf(pid=28240): Terminated: ok {rc=0} 13:50:53.258073 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28231): Process ended prematurely: osmo-stp_10.42.42.5(pid=28231) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:50:53.268425 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:50:53.296781 run osmo-hlr_10.42.42.2(pid=28228): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28228)] 13:50:53.347261 run osmo-hlr_10.42.42.2(pid=28228): stdout: | (launched: 2022-12-13_13:50:49.901117) 13:50:53.398717 run osmo-hlr_10.42.42.2(pid=28228): stderr: | 20221213135050100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135050100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135050100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135050100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135050100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135050100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135050112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135050121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135050121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135050121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:53.451257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28221): Terminating (SIGTERM) 13:50:53.492605 run iperf3-srv_10.42.42.10(pid=28222): Terminating (SIGTERM) 13:50:53.534492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28223): Terminating (SIGTERM) 13:50:53.576435 run iperf3-srv_10.42.42.10(pid=28224): Terminating (SIGTERM) 13:50:53.618357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Terminating (SIGTERM) 13:50:53.660380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Terminating (SIGTERM) 13:50:53.702197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28233): Terminating (SIGTERM) 13:50:53.744448 --- ParallelTerminationStrategy: PID 28221 died... 13:50:53.764666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28221): Terminated: ok {rc=0} 13:50:53.810684 --- ParallelTerminationStrategy: PID 28222 died... 13:50:53.830297 run iperf3-srv_10.42.42.10(pid=28222): Terminated {rc=256} 13:50:53.876137 --- ParallelTerminationStrategy: PID 28223 died... 13:50:53.895977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28223): Terminated: ok {rc=0} 13:50:53.941861 --- ParallelTerminationStrategy: PID 28224 died... 13:50:53.961551 run iperf3-srv_10.42.42.10(pid=28224): Terminated {rc=256} 13:50:54.007428 --- ParallelTerminationStrategy: PID 28227 died... 13:50:54.027099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Terminated: ok {rc=0} 13:50:54.072938 --- ParallelTerminationStrategy: PID 28230 died... 13:50:54.092815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Terminated: ok {rc=0} 13:50:54.138843 --- ParallelTerminationStrategy: PID 28233 died... 13:50:54.158658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28233): Terminated: ok {rc=0} 13:50:54.246454 bus /gobi_0: Setting Powered False 13:50:55.344857 bus /gobi_0: Setting Powered False 13:50:56.460204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:50:57.608308 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:57.620263 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:57.672291 tst iperf3.py: using LAC 34377 13:50:57.801394 tst iperf3.py: using RAC 207 13:50:57.923018 tst iperf3.py: using CellId 34377 13:50:58.049368 tst iperf3.py: using BVCI 34378 13:50:58.161825 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.172572 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.183278 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.194085 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.204674 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.215218 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.225973 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.236485 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:58.247281 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:58.367757 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:58.587330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:58.912850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28241): Launched 13:50:59.196185 run iperf3-srv_10.42.42.10(pid=28242): Launched 13:50:59.319750 tst iperf3.py:8: start network... 13:50:59.537755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:00.039093 run create_hlr_db(pid=28243): Launched 13:51:00.163465 bus /gobi_6: Setting Powered False 13:51:01.226557 run create_hlr_db(pid=28243): Terminated: ok {rc=0} 13:51:01.692402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Launched 13:51:02.039049 run osmo-hlr_10.42.42.2(pid=28246): Launched 13:51:02.195033 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:02.717158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Launched 13:51:03.020909 run osmo-stp_10.42.42.5(pid=28249): Launched 13:51:03.134810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:03.658035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28251): Launched 13:51:03.777118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:04.034009 run patchelf(pid=28252): Launched 13:51:04.204853 run osmo-stp_10.42.42.5(pid=28249): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] 13:51:04.333577 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-13_13:51:02.963921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:04.464010 run osmo-stp_10.42.42.5(pid=28249): stderr: | 20221213135103134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135103134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135103134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135103135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135103135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135103135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135103135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:04.594745 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-13_13:51:02.963921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:04.719535 run osmo-stp_10.42.42.5(pid=28249): stderr: | 20221213135103134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135103134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135103134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135103135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135103135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135103135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135103135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:04.867334 run patchelf(pid=28252): Terminating (SIGINT) 13:51:05.038681 run patchelf(pid=28252): Terminated: ok {rc=0} 13:51:05.162028 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 13:51:05.171498 tst iperf3.py:8: Test FAILED (7.6 sec) 13:51:05.198609 run osmo-hlr_10.42.42.2(pid=28246): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28246)] 13:51:05.246139 run osmo-hlr_10.42.42.2(pid=28246): stdout: | (launched: 2022-12-13_13:51:01.973503) 13:51:05.295396 run osmo-hlr_10.42.42.2(pid=28246): stderr: | 20221213135102201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135102201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135102201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135102201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135102201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135102201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135102213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135102222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135102223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135102223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:05.345216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28241): Terminating (SIGTERM) 13:51:05.385110 run iperf3-srv_10.42.42.10(pid=28242): Terminating (SIGTERM) 13:51:05.424695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminating (SIGTERM) 13:51:05.464353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminating (SIGTERM) 13:51:05.504105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28251): Terminating (SIGTERM) 13:51:05.544185 --- ParallelTerminationStrategy: PID 28241 died... 13:51:05.563448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28241): Terminated: ok {rc=0} 13:51:05.607869 --- ParallelTerminationStrategy: PID 28242 died... 13:51:05.626626 run iperf3-srv_10.42.42.10(pid=28242): Terminated {rc=256} 13:51:05.670591 --- ParallelTerminationStrategy: PID 28245 died... 13:51:05.689788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminated: ok {rc=0} 13:51:05.733780 --- ParallelTerminationStrategy: PID 28248 died... 13:51:05.752553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminated: ok {rc=0} 13:51:05.796343 --- ParallelTerminationStrategy: PID 28251 died... 13:51:05.815260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28251): Terminated: ok {rc=0} 13:51:05.899148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:51:07.041354 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.052746 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:07.103925 tst iperf3m4.py: using LAC 34378 13:51:07.224626 tst iperf3m4.py: using RAC 208 13:51:07.345983 tst iperf3m4.py: using CellId 34378 13:51:07.467532 tst iperf3m4.py: using BVCI 34379 13:51:07.580204 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.591084 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.601724 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.612239 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.622938 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.633774 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.644568 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.655216 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:07.666146 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:07.787502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:07.910967 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:08.029131 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:08.147256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:08.351551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:08.655953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28253): Launched 13:51:08.921178 run iperf3-srv_10.42.42.10(pid=28254): Launched 13:51:09.035514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:51:09.238516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:09.542983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Launched 13:51:09.810756 run iperf3-srv_10.42.42.10(pid=28256): Launched 13:51:09.924821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:51:10.127279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:10.431205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Launched 13:51:10.696084 run iperf3-srv_10.42.42.10(pid=28258): Launched 13:51:10.810109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:51:11.012408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:11.317318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Launched 13:51:11.582062 run iperf3-srv_10.42.42.10(pid=28260): Launched 13:51:11.695947 tst iperf3m4.py:8: start network... 13:51:11.899664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:12.368733 run create_hlr_db(pid=28261): Launched 13:51:12.493898 bus /gobi_6: Setting Powered False 13:51:13.553534 run create_hlr_db(pid=28261): Terminated: ok {rc=0} 13:51:13.997681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28263): Launched 13:51:14.324711 run osmo-hlr_10.42.42.2(pid=28264): Launched 13:51:14.450699 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:15.014910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28266): Launched 13:51:15.341046 run osmo-stp_10.42.42.5(pid=28267): Launched 13:51:15.465865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:16.028499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28269): Launched 13:51:16.166358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:16.449714 run patchelf(pid=28270): Launched 13:51:16.645216 run osmo-stp_10.42.42.5(pid=28267): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28267)] 13:51:16.786610 run osmo-stp_10.42.42.5(pid=28267): stdout: | (launched: 2022-12-13_13:51:15.281329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:16.929900 run osmo-stp_10.42.42.5(pid=28267): stderr: | 20221213135115471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135115471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135115471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135115472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135115472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135115472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135115472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:17.073516 run osmo-stp_10.42.42.5(pid=28267): stdout: | (launched: 2022-12-13_13:51:15.281329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:17.211225 run osmo-stp_10.42.42.5(pid=28267): stderr: | 20221213135115471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135115471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135115471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135115472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135115472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135115472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135115472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:17.370314 run patchelf(pid=28270): Terminating (SIGINT) 13:51:17.554418 run patchelf(pid=28270): Terminated: ok {rc=0} 13:51:17.686846 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28267): Process ended prematurely: osmo-stp_10.42.42.5(pid=28267) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28267)] [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 13:51:17.697139 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:51:17.726139 run osmo-hlr_10.42.42.2(pid=28264): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28264)] 13:51:17.776665 run osmo-hlr_10.42.42.2(pid=28264): stdout: | (launched: 2022-12-13_13:51:14.264487) 13:51:17.828159 run osmo-hlr_10.42.42.2(pid=28264): stderr: | 20221213135114461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135114461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135114461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135114461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135114461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135114462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135114475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135114483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135114483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135114483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:17.880376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28253): Terminating (SIGTERM) 13:51:17.922235 run iperf3-srv_10.42.42.10(pid=28254): Terminating (SIGTERM) 13:51:17.963829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Terminating (SIGTERM) 13:51:18.006030 run iperf3-srv_10.42.42.10(pid=28256): Terminating (SIGTERM) 13:51:18.047792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminating (SIGTERM) 13:51:18.089870 run iperf3-srv_10.42.42.10(pid=28258): Terminating (SIGTERM) 13:51:18.131670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Terminating (SIGTERM) 13:51:18.173715 run iperf3-srv_10.42.42.10(pid=28260): Terminating (SIGTERM) 13:51:18.215269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28263): Terminating (SIGTERM) 13:51:18.257287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28266): Terminating (SIGTERM) 13:51:18.299191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28269): Terminating (SIGTERM) 13:51:18.341411 --- ParallelTerminationStrategy: PID 28253 died... 13:51:18.361783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28253): Terminated: ok {rc=0} 13:51:18.408048 --- ParallelTerminationStrategy: PID 28254 died... 13:51:18.427897 run iperf3-srv_10.42.42.10(pid=28254): Terminated {rc=256} 13:51:18.473856 --- ParallelTerminationStrategy: PID 28255 died... 13:51:18.493759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Terminated: ok {rc=0} 13:51:18.539663 --- ParallelTerminationStrategy: PID 28256 died... 13:51:18.559547 run iperf3-srv_10.42.42.10(pid=28256): Terminated {rc=256} 13:51:18.606591 --- ParallelTerminationStrategy: PID 28257 died... 13:51:18.625770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminated: ok {rc=0} 13:51:18.669600 --- ParallelTerminationStrategy: PID 28258 died... 13:51:18.688695 run iperf3-srv_10.42.42.10(pid=28258): Terminated {rc=256} 13:51:18.732566 --- ParallelTerminationStrategy: PID 28259 died... 13:51:18.751685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Terminated: ok {rc=0} 13:51:18.795467 --- ParallelTerminationStrategy: PID 28260 died... 13:51:18.814660 run iperf3-srv_10.42.42.10(pid=28260): Terminated {rc=256} 13:51:18.858400 --- ParallelTerminationStrategy: PID 28263 died... 13:51:18.877642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28263): Terminated: ok {rc=0} 13:51:18.921688 --- ParallelTerminationStrategy: PID 28266 died... 13:51:18.941033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28266): Terminated: ok {rc=0} 13:51:18.985322 --- ParallelTerminationStrategy: PID 28269 died... 13:51:19.004701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28269): Terminated: ok {rc=0} 13:51:19.091904 bus /gobi_4: Setting Powered False 13:51:20.190945 bus /gobi_4: Setting Powered False 13:51:21.304408 bus /gobi_1: Setting Powered False 13:51:22.402696 bus /gobi_1: Setting Powered False 13:51:23.519560 bus /gobi_0: Setting Powered False 13:51:24.617607 bus /gobi_0: Setting Powered False 13:51:25.736404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 13:51:26.839775 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:26.851132 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:26.902327 tst ping.py: using LAC 34379 13:51:27.021326 tst ping.py: using RAC 209 13:51:27.137707 tst ping.py: using CellId 34379 13:51:27.253772 tst ping.py: using BVCI 34380 13:51:27.361543 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.372271 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.382876 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.393458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.403980 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.414572 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.425368 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:27.435951 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:27.553228 tst ping.py:19: start network... 13:51:27.767799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:28.260141 run create_hlr_db(pid=28271): Launched 13:51:28.382881 bus /gobi_6: Setting Powered False 13:51:29.445706 run create_hlr_db(pid=28271): Terminated: ok {rc=0} 13:51:29.890358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Launched 13:51:30.211775 run osmo-hlr_10.42.42.2(pid=28274): Launched 13:51:30.335301 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:30.896843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Launched 13:51:31.217270 run osmo-stp_10.42.42.5(pid=28277): Launched 13:51:31.517868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:32.102634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28279): Launched 13:51:32.230288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:32.485966 run patchelf(pid=28280): Launched 13:51:32.655117 run osmo-stp_10.42.42.5(pid=28277): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28277)] 13:51:32.782200 run osmo-stp_10.42.42.5(pid=28277): stdout: | (launched: 2022-12-13_13:51:31.158848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:32.911195 run osmo-stp_10.42.42.5(pid=28277): stderr: | 20221213135131378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135131378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135131378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135131378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135131379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135131379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135131379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:33.040043 run osmo-stp_10.42.42.5(pid=28277): stdout: | (launched: 2022-12-13_13:51:31.158848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:33.162622 run osmo-stp_10.42.42.5(pid=28277): stderr: | 20221213135131378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135131378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135131378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135131378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135131379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135131379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135131379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:33.307745 run patchelf(pid=28280): Terminating (SIGINT) 13:51:33.475919 run patchelf(pid=28280): Terminated: ok {rc=0} 13:51:33.597461 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28277): Process ended prematurely: osmo-stp_10.42.42.5(pid=28277) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28277)] [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 13:51:33.606469 tst ping.py:22: Test FAILED (6.8 sec) 13:51:33.633213 run osmo-hlr_10.42.42.2(pid=28274): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28274)] 13:51:33.681325 run osmo-hlr_10.42.42.2(pid=28274): stdout: | (launched: 2022-12-13_13:51:30.153083) 13:51:33.730574 run osmo-hlr_10.42.42.2(pid=28274): stderr: | 20221213135130348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135130348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135130348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135130348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135130348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135130348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135130364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135130374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135130374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135130374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:33.780167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Terminating (SIGTERM) 13:51:33.820380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Terminating (SIGTERM) 13:51:33.860357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28279): Terminating (SIGTERM) 13:51:33.901243 --- ParallelTerminationStrategy: PID 28273 died... 13:51:33.920740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28273): Terminated: ok {rc=0} 13:51:33.966388 --- ParallelTerminationStrategy: PID 28276 died... 13:51:33.985482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28276): Terminated: ok {rc=0} 13:51:34.029785 --- ParallelTerminationStrategy: PID 28279 died... 13:51:34.048913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28279): Terminated: ok {rc=0} 13:51:34.135777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:51:35.225787 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.237761 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:35.289865 tst ping_idle_ping.py: using LAC 34380 13:51:35.417802 tst ping_idle_ping.py: using RAC 210 13:51:35.536017 tst ping_idle_ping.py: using CellId 34380 13:51:35.655617 tst ping_idle_ping.py: using BVCI 34381 13:51:35.766129 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.777218 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.787970 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.798877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.809809 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.820586 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.831559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:35.842314 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:35.961704 tst ping_idle_ping.py:24: start network... 13:51:36.177479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:36.673925 run create_hlr_db(pid=28281): Launched 13:51:36.796159 bus /gobi_6: Setting Powered False 13:51:37.858982 run create_hlr_db(pid=28281): Terminated: ok {rc=0} 13:51:38.304684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Launched 13:51:38.625075 run osmo-hlr_10.42.42.2(pid=28284): Launched 13:51:38.748872 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:39.304096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Launched 13:51:39.625647 run osmo-stp_10.42.42.5(pid=28287): Launched 13:51:39.749503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:40.305233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Launched 13:51:40.427179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:40.697552 run patchelf(pid=28290): Launched 13:51:40.875995 run osmo-stp_10.42.42.5(pid=28287): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] 13:51:41.011918 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-13_13:51:39.566106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:41.149930 run osmo-stp_10.42.42.5(pid=28287): stderr: | 20221213135139758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135139758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135139758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135139758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135139759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135139759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135139759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:41.287657 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-13_13:51:39.566106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:41.419371 run osmo-stp_10.42.42.5(pid=28287): stderr: | 20221213135139758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135139758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135139758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135139758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135139759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135139759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135139759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:41.575850 run patchelf(pid=28290): Terminating (SIGINT) 13:51:41.756176 run patchelf(pid=28290): Terminated: ok {rc=0} 13:51:41.886355 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 13:51:41.895893 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:51:41.923954 run osmo-hlr_10.42.42.2(pid=28284): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28284)] 13:51:41.974927 run osmo-hlr_10.42.42.2(pid=28284): stdout: | (launched: 2022-12-13_13:51:38.565860) 13:51:42.027095 run osmo-hlr_10.42.42.2(pid=28284): stderr: | 20221213135138763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135138763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135138763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135138763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135138763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135138763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135138776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135138784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135138784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135138784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:42.079469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminating (SIGTERM) 13:51:42.121386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminating (SIGTERM) 13:51:42.163835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Terminating (SIGTERM) 13:51:42.206535 --- ParallelTerminationStrategy: PID 28283 died... 13:51:42.227126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminated: ok {rc=0} 13:51:42.273618 --- ParallelTerminationStrategy: PID 28286 died... 13:51:42.293689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminated: ok {rc=0} 13:51:42.341041 --- ParallelTerminationStrategy: PID 28289 died... 13:51:42.361227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Terminated: ok {rc=0} 13:51:42.450554 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:51:43.753576 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:51:43.760082 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:51:43.793434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:51:43.831914 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:51:43.917693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:51:43.950532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:51:43.989189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:51:44.582049 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:51:44.638044 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.649530 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:44.719589 tst cs_paging_gprs_active.py: using LAC 34381 13:51:44.847757 tst cs_paging_gprs_active.py: using RAC 211 13:51:44.974610 tst cs_paging_gprs_active.py: using CellId 34381 13:51:45.102607 tst cs_paging_gprs_active.py: using BVCI 34382 13:51:45.223621 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.235028 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.246253 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.257503 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.269058 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.280734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.292644 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.304407 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:45.316356 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:45.433391 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:45.553458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:51:45.774627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:46.126102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28294): Launched 13:51:46.424494 run iperf3-srv_10.42.42.10(pid=28295): Launched 13:51:46.562209 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:51:46.786862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:47.121763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28296): Launched 13:51:47.417318 run iperf3-srv_10.42.42.10(pid=28297): Launched 13:51:47.539410 tst cs_paging_gprs_active.py:38: start network... 13:51:47.758712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:48.264516 run create_hlr_db(pid=28298): Launched 13:51:48.390032 bus /gobi_6: Setting Powered False 13:51:49.454382 run create_hlr_db(pid=28298): Terminated: ok {rc=0} 13:51:49.906842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28300): Launched 13:51:50.234494 run osmo-hlr_10.42.42.2(pid=28301): Launched 13:51:50.360090 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:50.915988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28303): Launched 13:51:51.242377 run osmo-stp_10.42.42.5(pid=28304): Launched 13:51:51.367509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:51.928657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28306): Launched 13:51:52.056092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:52.339140 run patchelf(pid=28307): Launched 13:51:52.522073 run osmo-stp_10.42.42.5(pid=28304): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28304)] 13:51:52.660092 run osmo-stp_10.42.42.5(pid=28304): stdout: | (launched: 2022-12-13_13:51:51.182808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:52.799694 run osmo-stp_10.42.42.5(pid=28304): stderr: | 20221213135151373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135151373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135151373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135151374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135151374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135151374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135151375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:52.939513 run osmo-stp_10.42.42.5(pid=28304): stdout: | (launched: 2022-12-13_13:51:51.182808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:53.073121 run osmo-stp_10.42.42.5(pid=28304): stderr: | 20221213135151373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135151373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135151373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135151374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135151374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135151374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135151375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:53.231722 run patchelf(pid=28307): Terminating (SIGINT) 13:51:53.415153 run patchelf(pid=28307): Terminated: ok {rc=0} 13:51:53.547263 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28304): Process ended prematurely: osmo-stp_10.42.42.5(pid=28304) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28304)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:51:53.557556 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:51:53.586491 run osmo-hlr_10.42.42.2(pid=28301): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28301)] 13:51:53.636876 run osmo-hlr_10.42.42.2(pid=28301): stdout: | (launched: 2022-12-13_13:51:50.174563) 13:51:53.689126 run osmo-hlr_10.42.42.2(pid=28301): stderr: | 20221213135150372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135150372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135150372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135150372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135150372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135150372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135150385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135150393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135150394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135150394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:53.741505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28294): Terminating (SIGTERM) 13:51:53.783268 run iperf3-srv_10.42.42.10(pid=28295): Terminating (SIGTERM) 13:51:53.825467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28296): Terminating (SIGTERM) 13:51:53.867680 run iperf3-srv_10.42.42.10(pid=28297): Terminating (SIGTERM) 13:51:53.909852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28300): Terminating (SIGTERM) 13:51:53.951964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28303): Terminating (SIGTERM) 13:51:53.994012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28306): Terminating (SIGTERM) 13:51:54.036404 --- ParallelTerminationStrategy: PID 28294 died... 13:51:54.056902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28294): Terminated: ok {rc=0} 13:51:54.103309 --- ParallelTerminationStrategy: PID 28295 died... 13:51:54.123132 run iperf3-srv_10.42.42.10(pid=28295): Terminated {rc=256} 13:51:54.169329 --- ParallelTerminationStrategy: PID 28296 died... 13:51:54.189190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28296): Terminated: ok {rc=0} 13:51:54.235255 --- ParallelTerminationStrategy: PID 28297 died... 13:51:54.255157 run iperf3-srv_10.42.42.10(pid=28297): Terminated {rc=256} 13:51:54.301119 --- ParallelTerminationStrategy: PID 28300 died... 13:51:54.320906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28300): Terminated: ok {rc=0} 13:51:54.366914 --- ParallelTerminationStrategy: PID 28303 died... 13:51:54.386738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28303): Terminated: ok {rc=0} 13:51:54.432875 --- ParallelTerminationStrategy: PID 28306 died... 13:51:54.453299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28306): Terminated: ok {rc=0} 13:51:54.540639 bus /gobi_0: Setting Powered False 13:51:55.640166 bus /gobi_0: Setting Powered False 13:51:56.757539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:51:57.906972 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:57.919062 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:57.990292 tst iperf3.py: using LAC 34382 13:51:58.117215 tst iperf3.py: using RAC 212 13:51:58.245490 tst iperf3.py: using CellId 34382 13:51:58.372895 tst iperf3.py: using BVCI 34383 13:51:58.492930 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.504441 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.515741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.527080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.538692 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.550296 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.562079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.573538 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:58.585488 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:58.702126 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:58.906294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:59.210863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Launched 13:51:59.475698 run iperf3-srv_10.42.42.10(pid=28309): Launched 13:51:59.590945 tst iperf3.py:8: start network... 13:51:59.794145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:00.264047 run create_hlr_db(pid=28310): Launched 13:52:00.389478 bus /gobi_6: Setting Powered False 13:52:01.448726 run create_hlr_db(pid=28310): Terminated: ok {rc=0} 13:52:01.883196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28312): Launched 13:52:02.212361 run osmo-hlr_10.42.42.2(pid=28313): Launched 13:52:02.347677 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:02.872251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28315): Launched 13:52:03.176599 run osmo-stp_10.42.42.5(pid=28316): Launched 13:52:03.294642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:03.819351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28318): Launched 13:52:03.935672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:04.192671 run patchelf(pid=28319): Launched 13:52:04.360843 run osmo-stp_10.42.42.5(pid=28316): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28316)] 13:52:04.489546 run osmo-stp_10.42.42.5(pid=28316): stdout: | (launched: 2022-12-13_13:52:03.120365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:04.619593 run osmo-stp_10.42.42.5(pid=28316): stderr: | 20221213135203286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135203286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135203287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135203287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135203288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135203288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135203288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:04.750010 run osmo-stp_10.42.42.5(pid=28316): stdout: | (launched: 2022-12-13_13:52:03.120365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:04.874052 run osmo-stp_10.42.42.5(pid=28316): stderr: | 20221213135203286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135203286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135203287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135203287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135203288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135203288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135203288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:05.021325 run patchelf(pid=28319): Terminating (SIGINT) 13:52:05.192222 run patchelf(pid=28319): Terminated: ok {rc=0} 13:52:05.314555 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28316): Process ended prematurely: osmo-stp_10.42.42.5(pid=28316) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28316)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 13:52:05.324020 tst iperf3.py:8: Test FAILED (7.5 sec) 13:52:05.351137 run osmo-hlr_10.42.42.2(pid=28313): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28313)] 13:52:05.398433 run osmo-hlr_10.42.42.2(pid=28313): stdout: | (launched: 2022-12-13_13:52:02.151525) 13:52:05.447547 run osmo-hlr_10.42.42.2(pid=28313): stderr: | 20221213135202349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135202349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135202349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135202349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135202349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135202349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135202361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135202369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135202369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135202369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:05.497094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminating (SIGTERM) 13:52:05.536473 run iperf3-srv_10.42.42.10(pid=28309): Terminating (SIGTERM) 13:52:05.576005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28312): Terminating (SIGTERM) 13:52:05.615599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28315): Terminating (SIGTERM) 13:52:05.655051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28318): Terminating (SIGTERM) 13:52:05.694860 --- ParallelTerminationStrategy: PID 28308 died... 13:52:05.713926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminated: ok {rc=0} 13:52:05.757651 --- ParallelTerminationStrategy: PID 28309 died... 13:52:05.776109 run iperf3-srv_10.42.42.10(pid=28309): Terminated {rc=256} 13:52:05.819665 --- ParallelTerminationStrategy: PID 28312 died... 13:52:05.838204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28312): Terminated: ok {rc=0} 13:52:05.881675 --- ParallelTerminationStrategy: PID 28315 died... 13:52:05.900263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28315): Terminated: ok {rc=0} 13:52:05.943905 --- ParallelTerminationStrategy: PID 28318 died... 13:52:05.962654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28318): Terminated: ok {rc=0} 13:52:06.045532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:52:07.187848 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.199300 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:07.269567 tst iperf3m4.py: using LAC 34383 13:52:07.388134 tst iperf3m4.py: using RAC 213 13:52:07.507069 tst iperf3m4.py: using CellId 34383 13:52:07.627692 tst iperf3m4.py: using BVCI 34384 13:52:07.738198 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.749153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.759698 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.770416 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.781020 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.791628 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.802381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.812855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:07.823727 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:07.944789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:08.062374 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:08.182305 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:08.298846 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:08.502334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:08.806197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Launched 13:52:09.072380 run iperf3-srv_10.42.42.10(pid=28322): Launched 13:52:09.186066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:52:09.387917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:09.692007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28323): Launched 13:52:09.955945 run iperf3-srv_10.42.42.10(pid=28324): Launched 13:52:10.069534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:52:10.271368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:10.574390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Launched 13:52:10.840208 run iperf3-srv_10.42.42.10(pid=28326): Launched 13:52:10.953883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:52:11.155340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:11.459079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28327): Launched 13:52:11.722491 run iperf3-srv_10.42.42.10(pid=28328): Launched 13:52:11.838295 tst iperf3m4.py:8: start network... 13:52:12.039619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:12.510182 run create_hlr_db(pid=28329): Launched 13:52:12.635902 bus /gobi_6: Setting Powered False 13:52:13.695708 run create_hlr_db(pid=28329): Terminated: ok {rc=0} 13:52:14.137744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28331): Launched 13:52:14.462584 run osmo-hlr_10.42.42.2(pid=28332): Launched 13:52:14.588670 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:15.150216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28334): Launched 13:52:15.474582 run osmo-stp_10.42.42.5(pid=28335): Launched 13:52:15.601152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:16.176150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28337): Launched 13:52:16.300356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:16.573736 run patchelf(pid=28338): Launched 13:52:16.758021 run osmo-stp_10.42.42.5(pid=28335): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28335)] 13:52:16.937916 run osmo-stp_10.42.42.5(pid=28335): stdout: | (launched: 2022-12-13_13:52:15.414986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:17.112438 run osmo-stp_10.42.42.5(pid=28335): stderr: | 20221213135215604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135215604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135215604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135215605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135215605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135215605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135215605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:17.245496 run osmo-stp_10.42.42.5(pid=28335): stdout: | (launched: 2022-12-13_13:52:15.414986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:17.372389 run osmo-stp_10.42.42.5(pid=28335): stderr: | 20221213135215604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135215604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135215604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135215605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135215605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135215605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135215605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:17.518933 run patchelf(pid=28338): Terminating (SIGINT) 13:52:17.689190 run patchelf(pid=28338): Terminated: ok {rc=0} 13:52:17.811643 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28335): Process ended prematurely: osmo-stp_10.42.42.5(pid=28335) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28335)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:52:17.821388 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:52:17.848752 run osmo-hlr_10.42.42.2(pid=28332): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28332)] 13:52:17.896102 run osmo-hlr_10.42.42.2(pid=28332): stdout: | (launched: 2022-12-13_13:52:14.403008) 13:52:17.945304 run osmo-hlr_10.42.42.2(pid=28332): stderr: | 20221213135214599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135214599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135214599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135214599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135214599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135214599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135214611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135214620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135214621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135214621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:17.994604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Terminating (SIGTERM) 13:52:18.034398 run iperf3-srv_10.42.42.10(pid=28322): Terminating (SIGTERM) 13:52:18.073928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28323): Terminating (SIGTERM) 13:52:18.113618 run iperf3-srv_10.42.42.10(pid=28324): Terminating (SIGTERM) 13:52:18.153093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Terminating (SIGTERM) 13:52:18.192537 run iperf3-srv_10.42.42.10(pid=28326): Terminating (SIGTERM) 13:52:18.231925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28327): Terminating (SIGTERM) 13:52:18.271915 run iperf3-srv_10.42.42.10(pid=28328): Terminating (SIGTERM) 13:52:18.311443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28331): Terminating (SIGTERM) 13:52:18.351616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28334): Terminating (SIGTERM) 13:52:18.391501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28337): Terminating (SIGTERM) 13:52:18.431254 --- ParallelTerminationStrategy: PID 28321 died... 13:52:18.450020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Terminated: ok {rc=0} 13:52:18.493685 --- ParallelTerminationStrategy: PID 28322 died... 13:52:18.512429 run iperf3-srv_10.42.42.10(pid=28322): Terminated {rc=256} 13:52:18.556489 --- ParallelTerminationStrategy: PID 28323 died... 13:52:18.575202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28323): Terminated: ok {rc=0} 13:52:18.619627 --- ParallelTerminationStrategy: PID 28324 died... 13:52:18.638322 run iperf3-srv_10.42.42.10(pid=28324): Terminated {rc=256} 13:52:18.681907 --- ParallelTerminationStrategy: PID 28325 died... 13:52:18.700511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Terminated: ok {rc=0} 13:52:18.744422 --- ParallelTerminationStrategy: PID 28326 died... 13:52:18.763020 run iperf3-srv_10.42.42.10(pid=28326): Terminated {rc=256} 13:52:18.806673 --- ParallelTerminationStrategy: PID 28327 died... 13:52:18.825368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28327): Terminated: ok {rc=0} 13:52:18.869194 --- ParallelTerminationStrategy: PID 28328 died... 13:52:18.887878 run iperf3-srv_10.42.42.10(pid=28328): Terminated {rc=256} 13:52:18.931646 --- ParallelTerminationStrategy: PID 28331 died... 13:52:18.950475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28331): Terminated: ok {rc=0} 13:52:18.994253 --- ParallelTerminationStrategy: PID 28334 died... 13:52:19.012915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28334): Terminated: ok {rc=0} 13:52:19.056707 --- ParallelTerminationStrategy: PID 28337 died... 13:52:19.076052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28337): Terminated: ok {rc=0} 13:52:19.160177 bus /gobi_4: Setting Powered False 13:52:20.258587 bus /gobi_4: Setting Powered False 13:52:21.377447 bus /gobi_1: Setting Powered False 13:52:22.475794 bus /gobi_1: Setting Powered False 13:52:23.588435 bus /gobi_0: Setting Powered False 13:52:24.686613 bus /gobi_0: Setting Powered False 13:52:25.805643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:52:26.909101 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:26.920614 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:26.989656 tst ping.py: using LAC 34384 13:52:27.109223 tst ping.py: using RAC 214 13:52:27.225474 tst ping.py: using CellId 34384 13:52:27.341954 tst ping.py: using BVCI 34385 13:52:27.448915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.459851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.470577 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.481201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.491743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.502431 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.513162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:27.523777 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:27.643352 tst ping.py:19: start network... 13:52:27.858215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:28.350869 run create_hlr_db(pid=28339): Launched 13:52:28.473678 bus /gobi_6: Setting Powered False 13:52:29.536798 run create_hlr_db(pid=28339): Terminated: ok {rc=0} 13:52:29.965263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28341): Launched 13:52:30.264815 run osmo-hlr_10.42.42.2(pid=28342): Launched 13:52:30.378487 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:30.937807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28344): Launched 13:52:31.270215 run osmo-stp_10.42.42.5(pid=28345): Launched 13:52:31.515489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:32.155747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28347): Launched 13:52:32.289429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:32.560068 run patchelf(pid=28348): Launched 13:52:32.739867 run osmo-stp_10.42.42.5(pid=28345): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28345)] 13:52:32.875250 run osmo-stp_10.42.42.5(pid=28345): stdout: | (launched: 2022-12-13_13:52:31.211238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:33.011967 run osmo-stp_10.42.42.5(pid=28345): stderr: | 20221213135231507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135231507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135231507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135231508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135231508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135231508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135231508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:33.148808 run osmo-stp_10.42.42.5(pid=28345): stdout: | (launched: 2022-12-13_13:52:31.211238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:33.279299 run osmo-stp_10.42.42.5(pid=28345): stderr: | 20221213135231507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135231507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135231507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135231508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135231508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135231508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135231508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:33.433687 run patchelf(pid=28348): Terminating (SIGINT) 13:52:33.612907 run patchelf(pid=28348): Terminated: ok {rc=0} 13:52:33.742371 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28345): Process ended prematurely: osmo-stp_10.42.42.5(pid=28345) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28345)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 13:52:33.752204 tst ping.py:22: Test FAILED (6.8 sec) 13:52:33.780455 run osmo-hlr_10.42.42.2(pid=28342): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28342)] 13:52:33.831573 run osmo-hlr_10.42.42.2(pid=28342): stdout: | (launched: 2022-12-13_13:52:30.208914) 13:52:33.883795 run osmo-hlr_10.42.42.2(pid=28342): stderr: | 20221213135230385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135230385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135230385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135230385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135230385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135230385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135230397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135230406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135230406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135230406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:33.936278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28341): Terminating (SIGTERM) 13:52:33.978051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28344): Terminating (SIGTERM) 13:52:34.020578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28347): Terminating (SIGTERM) 13:52:34.063278 --- ParallelTerminationStrategy: PID 28341 died... 13:52:34.083950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28341): Terminated: ok {rc=0} 13:52:34.131178 --- ParallelTerminationStrategy: PID 28344 died... 13:52:34.151490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28344): Terminated: ok {rc=0} 13:52:34.198136 --- ParallelTerminationStrategy: PID 28347 died... 13:52:34.218356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28347): Terminated: ok {rc=0} 13:52:34.306115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:52:35.392820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.406273 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:35.475922 tst ping_idle_ping.py: using LAC 34385 13:52:35.593413 tst ping_idle_ping.py: using RAC 215 13:52:35.711795 tst ping_idle_ping.py: using CellId 34385 13:52:35.830069 tst ping_idle_ping.py: using BVCI 34386 13:52:35.941247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.952253 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.962887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.973602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.984312 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:35.995039 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:36.005830 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:36.016480 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:36.132510 tst ping_idle_ping.py:24: start network... 13:52:36.332521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:36.798673 run create_hlr_db(pid=28349): Launched 13:52:36.922776 bus /gobi_6: Setting Powered False 13:52:37.982938 run create_hlr_db(pid=28349): Terminated: ok {rc=0} 13:52:38.420889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Launched 13:52:38.740458 run osmo-hlr_10.42.42.2(pid=28352): Launched 13:52:38.861409 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:39.412447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Launched 13:52:39.731929 run osmo-stp_10.42.42.5(pid=28355): Launched 13:52:39.854080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:40.405706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28357): Launched 13:52:40.528522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:40.799818 run patchelf(pid=28358): Launched 13:52:40.978864 run osmo-stp_10.42.42.5(pid=28355): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] 13:52:41.114098 run osmo-stp_10.42.42.5(pid=28355): stdout: | (launched: 2022-12-13_13:52:39.673081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:41.251070 run osmo-stp_10.42.42.5(pid=28355): stderr: | 20221213135239859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135239859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135239860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135239860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135239861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135239861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135239861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:41.388298 run osmo-stp_10.42.42.5(pid=28355): stdout: | (launched: 2022-12-13_13:52:39.673081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:41.519124 run osmo-stp_10.42.42.5(pid=28355): stderr: | 20221213135239859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135239859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135239860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135239860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135239861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135239861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135239861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:41.674741 run patchelf(pid=28358): Terminating (SIGINT) 13:52:41.853990 run patchelf(pid=28358): Terminated: ok {rc=0} 13:52:41.983189 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28355): Process ended prematurely: osmo-stp_10.42.42.5(pid=28355) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:52:41.992731 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:52:42.020759 run osmo-hlr_10.42.42.2(pid=28352): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28352)] 13:52:42.071000 run osmo-hlr_10.42.42.2(pid=28352): stdout: | (launched: 2022-12-13_13:52:38.681755) 13:52:42.122503 run osmo-hlr_10.42.42.2(pid=28352): stderr: | 20221213135238877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135238877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135238877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135238877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135238877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135238877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135238889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135238898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135238899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135238899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:42.174742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Terminating (SIGTERM) 13:52:42.216335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Terminating (SIGTERM) 13:52:42.258745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28357): Terminating (SIGTERM) 13:52:42.301279 --- ParallelTerminationStrategy: PID 28351 died... 13:52:42.321940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Terminated: ok {rc=0} 13:52:42.368410 --- ParallelTerminationStrategy: PID 28354 died... 13:52:42.388451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Terminated: ok {rc=0} 13:52:42.435044 --- ParallelTerminationStrategy: PID 28357 died... 13:52:42.455068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28357): Terminated: ok {rc=0} 13:52:42.542612 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:52:43.848112 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:43.854803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:52:43.888846 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:52:43.929130 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:52:44.018971 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:52:44.052745 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:52:44.092366 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:52:44.688913 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:52:44.741865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:44.753112 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:52:44.824848 tst cs_paging_gprs_active.py: using LAC 34386 13:52:44.952561 tst cs_paging_gprs_active.py: using RAC 216 13:52:45.081304 tst cs_paging_gprs_active.py: using CellId 34386 13:52:45.209180 tst cs_paging_gprs_active.py: using BVCI 34387 13:52:45.323498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.334585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.345569 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.356424 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.367886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.379224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.390752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.402110 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:45.413552 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:45.535184 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:45.659847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:52:45.872567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:46.188595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28362): Launched 13:52:46.472647 run iperf3-srv_10.42.42.10(pid=28363): Launched 13:52:46.605790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:52:46.812472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:47.127312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28364): Launched 13:52:47.407624 run iperf3-srv_10.42.42.10(pid=28365): Launched 13:52:47.520807 tst cs_paging_gprs_active.py:38: start network... 13:52:47.722957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:48.195328 run create_hlr_db(pid=28366): Launched 13:52:48.319887 bus /gobi_6: Setting Powered False 13:52:49.379819 run create_hlr_db(pid=28366): Terminated: ok {rc=0} 13:52:49.802203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Launched 13:52:50.106818 run osmo-hlr_10.42.42.2(pid=28369): Launched 13:52:50.221556 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:50.744859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Launched 13:52:51.049381 run osmo-stp_10.42.42.5(pid=28372): Launched 13:52:51.165735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:51.693594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Launched 13:52:51.810352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:52.071079 run patchelf(pid=28375): Launched 13:52:52.243545 run osmo-stp_10.42.42.5(pid=28372): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] 13:52:52.372046 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-13_13:52:50.992906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:52.502204 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221213135251163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135251163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135251164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135251164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135251165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135251165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135251165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:52.632754 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-13_13:52:50.992906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:52.756692 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221213135251163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135251163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135251164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135251164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135251165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135251165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135251165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:52.903500 run patchelf(pid=28375): Terminating (SIGINT) 13:52:53.074227 run patchelf(pid=28375): Terminated: ok {rc=0} 13:52:53.197405 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:52:53.206892 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:52:53.233885 run osmo-hlr_10.42.42.2(pid=28369): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28369)] 13:52:53.281175 run osmo-hlr_10.42.42.2(pid=28369): stdout: | (launched: 2022-12-13_13:52:50.049791) 13:52:53.330388 run osmo-hlr_10.42.42.2(pid=28369): stderr: | 20221213135250223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135250223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135250223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135250224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135250224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135250224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135250235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135250244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135250244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135250244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:53.379692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28362): Terminating (SIGTERM) 13:52:53.419171 run iperf3-srv_10.42.42.10(pid=28363): Terminating (SIGTERM) 13:52:53.458364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28364): Terminating (SIGTERM) 13:52:53.497652 run iperf3-srv_10.42.42.10(pid=28365): Terminating (SIGTERM) 13:52:53.536751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminating (SIGTERM) 13:52:53.576138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminating (SIGTERM) 13:52:53.615317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminating (SIGTERM) 13:52:53.654837 --- ParallelTerminationStrategy: PID 28362 died... 13:52:53.673955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28362): Terminated: ok {rc=0} 13:52:53.717504 --- ParallelTerminationStrategy: PID 28363 died... 13:52:53.735909 run iperf3-srv_10.42.42.10(pid=28363): Terminated {rc=256} 13:52:53.779254 --- ParallelTerminationStrategy: PID 28364 died... 13:52:53.797793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28364): Terminated: ok {rc=0} 13:52:53.841351 --- ParallelTerminationStrategy: PID 28365 died... 13:52:53.859837 run iperf3-srv_10.42.42.10(pid=28365): Terminated {rc=256} 13:52:53.903166 --- ParallelTerminationStrategy: PID 28368 died... 13:52:53.921631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminated: ok {rc=0} 13:52:53.965229 --- ParallelTerminationStrategy: PID 28371 died... 13:52:53.983606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminated: ok {rc=0} 13:52:54.027495 --- ParallelTerminationStrategy: PID 28374 died... 13:52:54.046076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminated: ok {rc=0} 13:52:54.132046 bus /gobi_0: Setting Powered False 13:52:55.230508 bus /gobi_0: Setting Powered False 13:52:56.346604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:52:57.492463 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:57.504058 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:52:57.573827 tst iperf3.py: using LAC 34387 13:52:57.696262 tst iperf3.py: using RAC 217 13:52:57.817639 tst iperf3.py: using CellId 34387 13:52:57.949720 tst iperf3.py: using BVCI 34388 13:52:58.060617 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.071463 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.082239 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.092928 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.103501 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.114200 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.124807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.135412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:58.146106 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:58.267609 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:58.488159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:58.816110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Launched 13:52:59.099781 run iperf3-srv_10.42.42.10(pid=28377): Launched 13:52:59.224224 tst iperf3.py:8: start network... 13:52:59.445034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:59.951379 run create_hlr_db(pid=28378): Launched 13:53:00.078352 bus /gobi_6: Setting Powered False 13:53:01.142540 run create_hlr_db(pid=28378): Terminated: ok {rc=0} 13:53:01.605936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Launched 13:53:01.950239 run osmo-hlr_10.42.42.2(pid=28381): Launched 13:53:02.107875 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:02.678030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Launched 13:53:02.985154 run osmo-stp_10.42.42.5(pid=28384): Launched 13:53:03.099491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:03.621289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Launched 13:53:03.736752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:03.993678 run patchelf(pid=28387): Launched 13:53:04.162576 run osmo-stp_10.42.42.5(pid=28384): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] 13:53:04.291345 run osmo-stp_10.42.42.5(pid=28384): stdout: | (launched: 2022-12-13_13:53:02.927996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:04.421254 run osmo-stp_10.42.42.5(pid=28384): stderr: | 20221213135303098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135303098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135303098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135303099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135303099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135303099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135303099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:04.551913 run osmo-stp_10.42.42.5(pid=28384): stdout: | (launched: 2022-12-13_13:53:02.927996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:04.676821 run osmo-stp_10.42.42.5(pid=28384): stderr: | 20221213135303098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135303098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135303098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135303099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135303099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135303099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135303099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:04.824558 run patchelf(pid=28387): Terminating (SIGINT) 13:53:04.995323 run patchelf(pid=28387): Terminated: ok {rc=0} 13:53:05.117779 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28384): Process ended prematurely: osmo-stp_10.42.42.5(pid=28384) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 13:53:05.127098 tst iperf3.py:8: Test FAILED (7.7 sec) 13:53:05.153979 run osmo-hlr_10.42.42.2(pid=28381): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28381)] 13:53:05.200873 run osmo-hlr_10.42.42.2(pid=28381): stdout: | (launched: 2022-12-13_13:53:01.889909) 13:53:05.249571 run osmo-hlr_10.42.42.2(pid=28381): stderr: | 20221213135302245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135302245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135302245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135302245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135302245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135302245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135302258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135302266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135302266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135302266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:05.298615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminating (SIGTERM) 13:53:05.337965 run iperf3-srv_10.42.42.10(pid=28377): Terminating (SIGTERM) 13:53:05.377124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Terminating (SIGTERM) 13:53:05.416506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Terminating (SIGTERM) 13:53:05.455805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Terminating (SIGTERM) 13:53:05.495575 --- ParallelTerminationStrategy: PID 28376 died... 13:53:05.514705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminated: ok {rc=0} 13:53:05.558520 --- ParallelTerminationStrategy: PID 28377 died... 13:53:05.577311 run iperf3-srv_10.42.42.10(pid=28377): Terminated {rc=256} 13:53:05.620928 --- ParallelTerminationStrategy: PID 28380 died... 13:53:05.640042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Terminated: ok {rc=0} 13:53:05.683543 --- ParallelTerminationStrategy: PID 28383 died... 13:53:05.702114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Terminated: ok {rc=0} 13:53:05.745321 --- ParallelTerminationStrategy: PID 28386 died... 13:53:05.764006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Terminated: ok {rc=0} 13:53:05.849806 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:53:06.995756 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.007351 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:53:07.078014 tst iperf3m4.py: using LAC 34388 13:53:07.200096 tst iperf3m4.py: using RAC 218 13:53:07.322109 tst iperf3m4.py: using CellId 34388 13:53:07.451251 tst iperf3m4.py: using BVCI 34389 13:53:07.572222 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.583932 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.595303 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.606681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.618737 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.630497 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.642297 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.653863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:07.665646 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:07.783540 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:07.907836 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:08.026318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:08.143113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:53:08.347716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:08.654088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Launched 13:53:08.922656 run iperf3-srv_10.42.42.10(pid=28389): Launched 13:53:09.037213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:53:09.240555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:09.546183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28390): Launched 13:53:09.811457 run iperf3-srv_10.42.42.10(pid=28391): Launched 13:53:09.926095 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:53:10.130142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:10.435318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28392): Launched 13:53:10.702357 run iperf3-srv_10.42.42.10(pid=28393): Launched 13:53:10.816753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:53:11.019843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:11.326185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28394): Launched 13:53:11.592111 run iperf3-srv_10.42.42.10(pid=28395): Launched 13:53:11.706093 tst iperf3m4.py:8: start network... 13:53:11.908508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:12.379063 run create_hlr_db(pid=28396): Launched 13:53:12.504294 bus /gobi_6: Setting Powered False 13:53:13.565076 run create_hlr_db(pid=28396): Terminated: ok {rc=0} 13:53:14.010166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Launched 13:53:14.324540 run osmo-hlr_10.42.42.2(pid=28402): Launched 13:53:14.439203 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:14.965038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Launched 13:53:15.270604 run osmo-stp_10.42.42.5(pid=28405): Launched 13:53:15.385144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:15.939690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28407): Launched 13:53:16.088290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:16.379596 run patchelf(pid=28408): Launched 13:53:16.579745 run osmo-stp_10.42.42.5(pid=28405): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] 13:53:16.723662 run osmo-stp_10.42.42.5(pid=28405): stdout: | (launched: 2022-12-13_13:53:15.213185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:16.866499 run osmo-stp_10.42.42.5(pid=28405): stderr: | 20221213135315383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135315384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135315384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135315384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135315385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135315385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135315385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:17.011695 run osmo-stp_10.42.42.5(pid=28405): stdout: | (launched: 2022-12-13_13:53:15.213185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:17.156226 run osmo-stp_10.42.42.5(pid=28405): stderr: | 20221213135315383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135315384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135315384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135315384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135315385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135315385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135315385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:17.317916 run patchelf(pid=28408): Terminating (SIGINT) 13:53:17.500456 run patchelf(pid=28408): Terminated: ok {rc=0} 13:53:17.631986 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28405): Process ended prematurely: osmo-stp_10.42.42.5(pid=28405) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:53:17.642452 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:53:17.671733 run osmo-hlr_10.42.42.2(pid=28402): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28402)] 13:53:17.722448 run osmo-hlr_10.42.42.2(pid=28402): stdout: | (launched: 2022-12-13_13:53:14.267213) 13:53:17.774599 run osmo-hlr_10.42.42.2(pid=28402): stderr: | 20221213135314444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135314444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135314444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135314445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135314445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135314445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135314457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135314466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135314466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135314466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:17.827178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Terminating (SIGTERM) 13:53:17.869127 run iperf3-srv_10.42.42.10(pid=28389): Terminating (SIGTERM) 13:53:17.911418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28390): Terminating (SIGTERM) 13:53:17.954048 run iperf3-srv_10.42.42.10(pid=28391): Terminating (SIGTERM) 13:53:17.996013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28392): Terminating (SIGTERM) 13:53:18.038346 run iperf3-srv_10.42.42.10(pid=28393): Terminating (SIGTERM) 13:53:18.080224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28394): Terminating (SIGTERM) 13:53:18.122483 run iperf3-srv_10.42.42.10(pid=28395): Terminating (SIGTERM) 13:53:18.164829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Terminating (SIGTERM) 13:53:18.207142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Terminating (SIGTERM) 13:53:18.249299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28407): Terminating (SIGTERM) 13:53:18.291653 --- ParallelTerminationStrategy: PID 28388 died... 13:53:18.311720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Terminated: ok {rc=0} 13:53:18.358399 --- ParallelTerminationStrategy: PID 28389 died... 13:53:18.378263 run iperf3-srv_10.42.42.10(pid=28389): Terminated {rc=256} 13:53:18.424801 --- ParallelTerminationStrategy: PID 28390 died... 13:53:18.445297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28390): Terminated: ok {rc=0} 13:53:18.492186 --- ParallelTerminationStrategy: PID 28391 died... 13:53:18.512177 run iperf3-srv_10.42.42.10(pid=28391): Terminated {rc=256} 13:53:18.558470 --- ParallelTerminationStrategy: PID 28392 died... 13:53:18.578389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28392): Terminated: ok {rc=0} 13:53:18.625119 --- ParallelTerminationStrategy: PID 28393 died... 13:53:18.645134 run iperf3-srv_10.42.42.10(pid=28393): Terminated {rc=256} 13:53:18.691772 --- ParallelTerminationStrategy: PID 28394 died... 13:53:18.711666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28394): Terminated: ok {rc=0} 13:53:18.758401 --- ParallelTerminationStrategy: PID 28395 died... 13:53:18.778335 run iperf3-srv_10.42.42.10(pid=28395): Terminated {rc=256} 13:53:18.824620 --- ParallelTerminationStrategy: PID 28398 died... 13:53:18.844775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Terminated: ok {rc=0} 13:53:18.891305 --- ParallelTerminationStrategy: PID 28404 died... 13:53:18.911357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Terminated: ok {rc=0} 13:53:18.958050 --- ParallelTerminationStrategy: PID 28407 died... 13:53:18.978175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28407): Terminated: ok {rc=0} 13:53:19.067163 bus /gobi_4: Setting Powered False 13:53:20.166172 bus /gobi_4: Setting Powered False 13:53:21.282838 bus /gobi_1: Setting Powered False 13:53:22.381675 bus /gobi_1: Setting Powered False 13:53:23.498177 bus /gobi_0: Setting Powered False 13:53:24.596403 bus /gobi_0: Setting Powered False 13:53:25.710847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:53:26.813135 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:26.824863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:53:26.897793 tst ping.py: using LAC 34389 13:53:27.014776 tst ping.py: using RAC 219 13:53:27.133014 tst ping.py: using CellId 34389 13:53:27.250277 tst ping.py: using BVCI 34390 13:53:27.360075 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.371205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.382128 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.392753 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.403352 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.414061 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.424739 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:27.435450 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:27.549478 tst ping.py:19: start network... 13:53:27.748288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:28.210826 run create_hlr_db(pid=28409): Launched 13:53:28.331804 bus /gobi_6: Setting Powered False 13:53:29.391077 run create_hlr_db(pid=28409): Terminated: ok {rc=0} 13:53:29.827535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28411): Launched 13:53:30.148010 run osmo-hlr_10.42.42.2(pid=28412): Launched 13:53:30.269812 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:30.822334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28414): Launched 13:53:31.199305 run osmo-stp_10.42.42.5(pid=28415): Launched 13:53:31.334183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:31.982316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28417): Launched 13:53:32.112816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:32.376901 run patchelf(pid=28418): Launched 13:53:32.558278 run osmo-stp_10.42.42.5(pid=28415): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28415)] 13:53:32.685380 run osmo-stp_10.42.42.5(pid=28415): stdout: | (launched: 2022-12-13_13:53:31.125148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:32.813805 run osmo-stp_10.42.42.5(pid=28415): stderr: | 20221213135331511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135331512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135331512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135331512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135331523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135331523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135331524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:32.942924 run osmo-stp_10.42.42.5(pid=28415): stdout: | (launched: 2022-12-13_13:53:31.125148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:33.064512 run osmo-stp_10.42.42.5(pid=28415): stderr: | 20221213135331511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135331512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135331512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135331512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135331523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135331523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135331524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:33.209241 run patchelf(pid=28418): Terminating (SIGINT) 13:53:33.377873 run patchelf(pid=28418): Terminated: ok {rc=0} 13:53:33.499256 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28415): Process ended prematurely: osmo-stp_10.42.42.5(pid=28415) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28415)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 13:53:33.508302 tst ping.py:22: Test FAILED (6.7 sec) 13:53:33.535212 run osmo-hlr_10.42.42.2(pid=28412): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28412)] 13:53:33.583086 run osmo-hlr_10.42.42.2(pid=28412): stdout: | (launched: 2022-12-13_13:53:30.088648) 13:53:33.632414 run osmo-hlr_10.42.42.2(pid=28412): stderr: | 20221213135330281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135330281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135330281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135330281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135330281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135330281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135330294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135330302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135330303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135330303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:33.682293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28411): Terminating (SIGTERM) 13:53:33.722250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28414): Terminating (SIGTERM) 13:53:33.762161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28417): Terminating (SIGTERM) 13:53:33.802589 --- ParallelTerminationStrategy: PID 28411 died... 13:53:33.821961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28411): Terminated: ok {rc=0} 13:53:33.866371 --- ParallelTerminationStrategy: PID 28414 died... 13:53:33.885236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28414): Terminated: ok {rc=0} 13:53:33.929220 --- ParallelTerminationStrategy: PID 28417 died... 13:53:33.947976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28417): Terminated: ok {rc=0} 13:53:34.033367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:53:35.120075 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.131521 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:53:35.202809 tst ping_idle_ping.py: using LAC 34390 13:53:35.320924 tst ping_idle_ping.py: using RAC 220 13:53:35.440391 tst ping_idle_ping.py: using CellId 34390 13:53:35.557355 tst ping_idle_ping.py: using BVCI 34391 13:53:35.664475 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.675447 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.686221 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.696881 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.707537 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.718250 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.729109 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:35.739686 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:35.858305 tst ping_idle_ping.py:24: start network... 13:53:36.056341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:36.519898 run create_hlr_db(pid=28419): Launched 13:53:36.642997 bus /gobi_6: Setting Powered False 13:53:37.703249 run create_hlr_db(pid=28419): Terminated: ok {rc=0} 13:53:38.140934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Launched 13:53:38.460908 run osmo-hlr_10.42.42.2(pid=28422): Launched 13:53:38.583680 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:39.137904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Launched 13:53:39.458643 run osmo-stp_10.42.42.5(pid=28425): Launched 13:53:39.580696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:40.131898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28427): Launched 13:53:40.254271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:40.524458 run patchelf(pid=28428): Launched 13:53:40.702817 run osmo-stp_10.42.42.5(pid=28425): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] 13:53:40.838417 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-13_13:53:39.399047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:40.976098 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221213135339588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135339588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135339589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135339589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135339590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135339590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135339590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:41.113695 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-13_13:53:39.399047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:41.244808 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221213135339588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135339588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135339589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135339589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135339590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135339590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135339590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:41.399832 run patchelf(pid=28428): Terminating (SIGINT) 13:53:41.579508 run patchelf(pid=28428): Terminated: ok {rc=0} 13:53:41.709181 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:53:41.718871 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:53:41.747061 run osmo-hlr_10.42.42.2(pid=28422): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28422)] 13:53:41.797710 run osmo-hlr_10.42.42.2(pid=28422): stdout: | (launched: 2022-12-13_13:53:38.401381) 13:53:41.850057 run osmo-hlr_10.42.42.2(pid=28422): stderr: | 20221213135338596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135338596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135338596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135338596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135338596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135338596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135338609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135338618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135338619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135338619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:41.902599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminating (SIGTERM) 13:53:41.944605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminating (SIGTERM) 13:53:41.986887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28427): Terminating (SIGTERM) 13:53:42.029655 --- ParallelTerminationStrategy: PID 28421 died... 13:53:42.049994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminated: ok {rc=0} 13:53:42.097113 --- ParallelTerminationStrategy: PID 28424 died... 13:53:42.117375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminated: ok {rc=0} 13:53:42.163756 --- ParallelTerminationStrategy: PID 28427 died... 13:53:42.183707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28427): Terminated: ok {rc=0} 13:53:42.271851 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:53:43.577279 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:43.584677 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:53:43.619633 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:53:43.655977 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:53:43.714538 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:53:43.747437 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:53:43.781550 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:53:44.338818 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:53:44.345371 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.357236 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:53:44.429666 tst switch_tch_pdch.py: using LAC 34391 13:53:44.559530 tst switch_tch_pdch.py: using RAC 221 13:53:44.683077 tst switch_tch_pdch.py: using CellId 34391 13:53:44.808096 tst switch_tch_pdch.py: using BVCI 34392 13:53:44.924264 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.935928 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.947410 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.959036 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.970880 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.982788 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:44.994986 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:45.006760 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:53:45.124346 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:53:45.252002 tst switch_tch_pdch.py:51: start network... 13:53:45.454058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:45.924804 run create_hlr_db(pid=28432): Launched 13:53:46.082031 bus /gobi_6: Setting Powered False 13:53:47.172924 run create_hlr_db(pid=28432): Terminated: ok {rc=0} 13:53:47.703089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28479): Launched 13:53:48.080435 run osmo-hlr_10.42.42.2(pid=28495): Launched 13:53:48.344872 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:49.122196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28617): Launched 13:53:49.520843 run osmo-stp_10.42.42.5(pid=28669): Launched 13:53:49.820382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:50.482144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28709): Launched 13:53:50.617002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:50.891650 run patchelf(pid=28710): Launched 13:53:51.083706 run osmo-stp_10.42.42.5(pid=28669): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28669)] 13:53:51.222957 run osmo-stp_10.42.42.5(pid=28669): stdout: | (launched: 2022-12-13_13:53:49.453191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:51.364490 run osmo-stp_10.42.42.5(pid=28669): stderr: | 20221213135349808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135349808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135349808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135349808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135349813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135349813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135349813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:51.505569 run osmo-stp_10.42.42.5(pid=28669): stdout: | (launched: 2022-12-13_13:53:49.453191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:51.639051 run osmo-stp_10.42.42.5(pid=28669): stderr: | 20221213135349808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135349808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135349808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135349808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135349813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135349813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135349813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:51.797676 run patchelf(pid=28710): Terminating (SIGINT) 13:53:51.980291 run patchelf(pid=28710): Terminated: ok {rc=0} 13:53:52.112089 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28669): Process ended prematurely: osmo-stp_10.42.42.5(pid=28669) [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28669)] [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:53:52.122736 tst switch_tch_pdch.py:54: Test FAILED (7.8 sec) 13:53:52.151882 run osmo-hlr_10.42.42.2(pid=28495): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28495)] 13:53:52.206139 run osmo-hlr_10.42.42.2(pid=28495): stdout: | (launched: 2022-12-13_13:53:48.008066) 13:53:52.260642 run osmo-hlr_10.42.42.2(pid=28495): stderr: | 20221213135348390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135348390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135348390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135348390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135348390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135348390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135348401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135348414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135348414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135348414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:52.315585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28479): Terminating (SIGTERM) 13:53:52.359227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28617): Terminating (SIGTERM) 13:53:52.403998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28709): Terminating (SIGTERM) 13:53:52.450140 --- ParallelTerminationStrategy: PID 28479 died... 13:53:52.472062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28479): Terminated: ok {rc=0} 13:53:52.521327 --- ParallelTerminationStrategy: PID 28617 died... 13:53:52.542576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28617): Terminated: ok {rc=0} 13:53:52.590353 --- ParallelTerminationStrategy: PID 28709 died... 13:53:52.611637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28709): Terminated: ok {rc=0} 13:53:52.703443 bus /gobi_0: Setting Powered False 13:53:53.805479 bus /gobi_0: Setting Powered False 13:53:54.924832 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:53:56.190063 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:56.197728 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:53:56.235143 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:53:56.273327 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:53:56.330259 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:53:56.366511 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:53:56.404648 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:53:56.958148 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:53:56.965277 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:56.977952 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:53:57.058483 tst switch_tch_pdch.py: using LAC 34392 13:53:57.187686 tst switch_tch_pdch.py: using RAC 222 13:53:57.315073 tst switch_tch_pdch.py: using CellId 34392 13:53:57.442765 tst switch_tch_pdch.py: using BVCI 34393 13:53:57.565468 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.577920 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.590622 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.602955 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.616145 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.629533 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.643062 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:57.656403 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:53:57.786261 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:53:57.913753 tst switch_tch_pdch.py:51: start network... 13:53:58.136426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:58.621045 run create_hlr_db(pid=28716): Launched 13:53:58.787077 bus /gobi_6: Setting Powered False 13:53:59.852386 run create_hlr_db(pid=28716): Terminated: ok {rc=0} 13:54:00.261140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28718): Launched 13:54:00.597843 run osmo-hlr_10.42.42.2(pid=28719): Launched 13:54:00.859055 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:01.498692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28721): Launched 13:54:01.858689 run osmo-stp_10.42.42.5(pid=28722): Launched 13:54:02.152522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:02.902168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28724): Launched 13:54:03.048274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:03.309774 run patchelf(pid=28725): Launched 13:54:03.500702 run osmo-stp_10.42.42.5(pid=28722): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28722)] 13:54:03.643188 run osmo-stp_10.42.42.5(pid=28722): stdout: | (launched: 2022-12-13_13:54:01.799907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:03.786809 run osmo-stp_10.42.42.5(pid=28722): stderr: | 20221213135402137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135402137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135402138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135402138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135402139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135402139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135402139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:03.929480 run osmo-stp_10.42.42.5(pid=28722): stdout: | (launched: 2022-12-13_13:54:01.799907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:04.065757 run osmo-stp_10.42.42.5(pid=28722): stderr: | 20221213135402137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135402137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135402138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135402138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135402139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135402139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135402139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:04.229103 run patchelf(pid=28725): Terminating (SIGINT) 13:54:04.417711 run patchelf(pid=28725): Terminated: ok {rc=0} 13:54:04.552741 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28722): Process ended prematurely: osmo-stp_10.42.42.5(pid=28722) [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28722)] [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:54:04.563816 tst switch_tch_pdch.py:54: Test FAILED (7.6 sec) 13:54:04.593849 run osmo-hlr_10.42.42.2(pid=28719): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28719)] 13:54:04.649533 run osmo-hlr_10.42.42.2(pid=28719): stdout: | (launched: 2022-12-13_13:54:00.536325) 13:54:04.704445 run osmo-hlr_10.42.42.2(pid=28719): stderr: | 20221213135400852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135400852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135400852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135400852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135400852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135400852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135400879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135400887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135400887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135400887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:04.760536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28718): Terminating (SIGTERM) 13:54:04.804275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28721): Terminating (SIGTERM) 13:54:04.851015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28724): Terminating (SIGTERM) 13:54:04.898434 --- ParallelTerminationStrategy: PID 28718 died... 13:54:04.920462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28718): Terminated: ok {rc=0} 13:54:04.972905 --- ParallelTerminationStrategy: PID 28721 died... 13:54:04.993862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28721): Terminated: ok {rc=0} 13:54:05.043723 --- ParallelTerminationStrategy: PID 28724 died... 13:54:05.064741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28724): Terminated: ok {rc=0} 13:54:05.160071 bus /gobi_0: Setting Powered False 13:54:06.263435 bus /gobi_0: Setting Powered False 13:54:07.385178 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:54:08.645028 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:08.650469 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:54:08.682556 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:54:08.693803 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:54:08.748588 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:54:08.779600 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:54:08.787949 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:54:09.325978 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:54:09.333394 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:54:09.347176 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:54:09.396199 tst mo_mt_sms.py: using LAC 34393 13:54:09.522437 tst mo_mt_sms.py: using RAC 223 13:54:09.650230 tst mo_mt_sms.py: using CellId 34393 13:54:09.778516 tst mo_mt_sms.py: using BVCI 34394 13:54:09.898478 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:54:10.024237 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:54:10.149536 tst mo_mt_sms.py:9: start nitb and bts... 13:54:10.375785 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:54:11.047775 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28729): Launched 13:54:11.391743 run osmo-nitb_10.42.42.2(pid=28730): Launched 13:54:11.586684 run osmo-nitb_10.42.42.2(pid=28730): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28730)] 13:54:11.720588 run osmo-nitb_10.42.42.2(pid=28730): stdout: | (launched: 2022-12-13_13:54:11.329352) 13:54:11.855778 run osmo-nitb_10.42.42.2(pid=28730): stderr: | (launched: 2022-12-13_13:54:11.381289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:11.991126 run osmo-nitb_10.42.42.2(pid=28730): stdout: | (launched: 2022-12-13_13:54:11.329352) 13:54:12.120610 run osmo-nitb_10.42.42.2(pid=28730): stderr: | (launched: 2022-12-13_13:54:11.381289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28730) [trial-2390↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28730)] 13:54:12.533395 tst osmo-nitb_10.42.42.2(pid=28730): stdout: | (launched: 2022-12-13_13:54:11.329352) 13:54:12.654482 tst osmo-nitb_10.42.42.2(pid=28730): stderr: | (launched: 2022-12-13_13:54:11.381289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:12.796192 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28730) [trial-2390↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28730)] [trial-2390↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 13:54:12.804719 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 13:54:12.811621 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28729): Terminating (SIGTERM) 13:54:13.020088 --- ParallelTerminationStrategy: PID 28729 died... 13:54:13.041264 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28729): Terminated: ok {rc=0} 13:54:13.127414 bus /sierra_3: Setting Powered False 13:54:14.229722 bus /sierra_3: Setting Powered False 13:54:15.347560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:54:16.578831 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:16.583876 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:54:16.618363 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:54:16.648324 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:54:16.707307 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:54:16.747989 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:54:16.784308 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:54:17.306849 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:54:17.312135 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.323234 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:54:17.367643 tst mo_mt_sms.py: using LAC 34394 13:54:17.485951 tst mo_mt_sms.py: using RAC 224 13:54:17.602296 tst mo_mt_sms.py: using CellId 34394 13:54:17.720031 tst mo_mt_sms.py: using BVCI 34395 13:54:17.839667 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.851088 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.862525 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.873761 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.885481 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:17.897095 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:54:18.014600 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:54:18.134070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:18.629202 run create_hlr_db(pid=28735): Launched 13:54:18.752471 bus /sierra_2: Setting Powered False 13:54:19.814650 run create_hlr_db(pid=28735): Terminated: ok {rc=0} 13:54:20.242849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Launched 13:54:20.542351 run osmo-hlr_10.42.42.2(pid=28738): Launched 13:54:20.658094 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:21.173528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Launched 13:54:21.473846 run osmo-stp_10.42.42.5(pid=28741): Launched 13:54:21.587043 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:22.128923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Launched 13:54:22.427358 run osmo-msc_10.42.42.6(pid=28744): Launched 13:54:22.595250 run osmo-stp_10.42.42.5(pid=28741): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] 13:54:22.720783 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-13_13:54:21.417875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:22.846891 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221213135421587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135421587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135421587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135421588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135421588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135421588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135421588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:22.971403 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-13_13:54:21.417875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:23.089244 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221213135421587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135421587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135421587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135421588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135421588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135421588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135421588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:23.230508 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 13:54:23.238722 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:54:23.265600 run osmo-hlr_10.42.42.2(pid=28738): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28738)] 13:54:23.313311 run osmo-hlr_10.42.42.2(pid=28738): stdout: | (launched: 2022-12-13_13:54:20.486546) 13:54:23.362268 run osmo-hlr_10.42.42.2(pid=28738): stderr: | 20221213135420662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135420662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135420662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135420662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135420662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135420662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135420674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135420683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135420683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135420683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:23.430771 run osmo-msc_10.42.42.6(pid=28744): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28744)] 13:54:23.478129 run osmo-msc_10.42.42.6(pid=28744): stdout: | (launched: 2022-12-13_13:54:22.371198) 13:54:23.526806 run osmo-msc_10.42.42.6(pid=28744): stderr: | 20221213135422641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135422642 DLGLOBAL DEBUG validating counter group 0x7fa6704e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135422642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135422642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135422642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135422642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135422644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135422644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135422644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135422644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:23.576297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Terminating (SIGTERM) 13:54:23.615774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Terminating (SIGTERM) 13:54:23.655240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminating (SIGTERM) 13:54:23.695008 --- ParallelTerminationStrategy: PID 28737 died... 13:54:23.714099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Terminated: ok {rc=0} 13:54:23.757721 --- ParallelTerminationStrategy: PID 28740 died... 13:54:23.776333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Terminated: ok {rc=0} 13:54:23.819961 --- ParallelTerminationStrategy: PID 28743 died... 13:54:23.838592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminated: ok {rc=0} 13:54:23.924164 bus /sierra_3: Setting Powered False 13:54:25.023932 bus /sierra_3: Setting Powered False 13:54:26.139947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:54:27.365329 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:27.369195 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:54:27.397743 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:54:27.404564 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:54:27.441617 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:54:27.471148 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:54:27.477989 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:54:27.996285 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:54:28.002712 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:54:28.014863 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:54:28.060864 tst assert_extension.py: using LAC 34395 13:54:28.185691 tst assert_extension.py: using RAC 225 13:54:28.312293 tst assert_extension.py: using CellId 34395 13:54:28.436871 tst assert_extension.py: using BVCI 34396 13:54:28.552894 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:54:28.669169 tst assert_extension.py:10: start nitb and bts... 13:54:28.868915 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:54:29.480625 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28749): Launched 13:54:29.779725 run osmo-nitb_10.42.42.2(pid=28750): Launched 13:54:29.944691 run osmo-nitb_10.42.42.2(pid=28750): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28750)] 13:54:30.078989 run osmo-nitb_10.42.42.2(pid=28750): stdout: | (launched: 2022-12-13_13:54:29.724084) 13:54:30.214795 run osmo-nitb_10.42.42.2(pid=28750): stderr: | (launched: 2022-12-13_13:54:29.768404) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:30.350248 run osmo-nitb_10.42.42.2(pid=28750): stdout: | (launched: 2022-12-13_13:54:29.724084) 13:54:30.480178 run osmo-nitb_10.42.42.2(pid=28750): stderr: | (launched: 2022-12-13_13:54:29.768404) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28750): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28750) [trial-2390↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28750)] 13:54:30.892001 tst osmo-nitb_10.42.42.2(pid=28750): stdout: | (launched: 2022-12-13_13:54:29.724084) 13:54:31.028853 tst osmo-nitb_10.42.42.2(pid=28750): stderr: | (launched: 2022-12-13_13:54:29.768404) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:31.186191 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28750): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28750) [trial-2390↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28750)] [trial-2390↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 13:54:31.196103 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:54:31.204299 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28749): Terminating (SIGTERM) 13:54:31.419509 --- ParallelTerminationStrategy: PID 28749 died... 13:54:31.440082 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28749): Terminated: ok {rc=0} 13:54:31.537934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:54:32.710666 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:32.715960 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:54:32.745993 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:54:32.778208 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:54:32.814814 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:54:32.845502 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:54:32.873658 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:54:33.402937 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:54:33.408377 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:33.419819 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:54:33.465935 tst assert_extension.py: using LAC 34396 13:54:33.591995 tst assert_extension.py: using RAC 226 13:54:33.720439 tst assert_extension.py: using CellId 34396 13:54:33.846125 tst assert_extension.py: using BVCI 34397 13:54:33.964671 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:33.976253 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:33.987635 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:33.998892 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:34.010757 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:54:34.022311 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:54:34.138006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:34.601420 run create_hlr_db(pid=28754): Launched 13:54:34.724617 bus /sierra_2: Setting Powered False 13:54:35.784316 run create_hlr_db(pid=28754): Terminated: ok {rc=0} 13:54:36.221524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Launched 13:54:36.544429 run osmo-hlr_10.42.42.2(pid=28757): Launched 13:54:36.667123 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:37.222767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Launched 13:54:37.546048 run osmo-stp_10.42.42.5(pid=28760): Launched 13:54:37.670245 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:38.247456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Launched 13:54:38.568821 run osmo-msc_10.42.42.6(pid=28763): Launched 13:54:38.748583 run osmo-stp_10.42.42.5(pid=28760): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] 13:54:38.882749 run osmo-stp_10.42.42.5(pid=28760): stdout: | (launched: 2022-12-13_13:54:37.486380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:39.017869 run osmo-stp_10.42.42.5(pid=28760): stderr: | 20221213135437678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135437678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135437678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135437679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135437679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135437679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135437679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:39.152498 run osmo-stp_10.42.42.5(pid=28760): stdout: | (launched: 2022-12-13_13:54:37.486380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:39.279363 run osmo-stp_10.42.42.5(pid=28760): stderr: | 20221213135437678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135437678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135437678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135437679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135437679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135437679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135437679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:39.431742 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28760): Process ended prematurely: osmo-stp_10.42.42.5(pid=28760) [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 13:54:39.440869 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:54:39.468142 run osmo-hlr_10.42.42.2(pid=28757): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28757)] 13:54:39.519493 run osmo-hlr_10.42.42.2(pid=28757): stdout: | (launched: 2022-12-13_13:54:36.484917) 13:54:39.571437 run osmo-hlr_10.42.42.2(pid=28757): stderr: | 20221213135436684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135436684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135436684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135436684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135436684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135436684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135436695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135436703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135436704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135436704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:39.643820 run osmo-msc_10.42.42.6(pid=28763): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28763)] 13:54:39.693796 run osmo-msc_10.42.42.6(pid=28763): stdout: | (launched: 2022-12-13_13:54:38.509576) 13:54:39.745916 run osmo-msc_10.42.42.6(pid=28763): stderr: | 20221213135438831 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135438831 DLGLOBAL DEBUG validating counter group 0x7f2bc973ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135438831 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135438832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135438832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135438832 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135438834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135438834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135438834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135438834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:39.798228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Terminating (SIGTERM) 13:54:39.839924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Terminating (SIGTERM) 13:54:39.882067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Terminating (SIGTERM) 13:54:39.924516 --- ParallelTerminationStrategy: PID 28756 died... 13:54:39.945154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Terminated: ok {rc=0} 13:54:39.991805 --- ParallelTerminationStrategy: PID 28759 died... 13:54:40.011783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Terminated: ok {rc=0} 13:54:40.058113 --- ParallelTerminationStrategy: PID 28762 died... 13:54:40.078276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Terminated: ok {rc=0} 13:54:40.165628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:54:41.372451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:41.379416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:54:41.409341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:54:41.436488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:54:41.491311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:54:41.520516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:54:41.547615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:54:42.096148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:54:42.146742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.158415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:54:42.227440 tst mo_mt_call.py: using LAC 34397 13:54:42.355377 tst mo_mt_call.py: using RAC 227 13:54:42.482774 tst mo_mt_call.py: using CellId 34397 13:54:42.608372 tst mo_mt_call.py: using BVCI 34398 13:54:42.727690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.739635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.751462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.763001 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.775191 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:42.787184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:42.907292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:43.029923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:43.503635 run create_hlr_db(pid=28769): Launched 13:54:43.628581 bus /sierra_2: Setting Powered False 13:54:44.689256 run create_hlr_db(pid=28769): Terminated: ok {rc=0} 13:54:45.132818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28771): Launched 13:54:45.459236 run osmo-hlr_10.42.42.2(pid=28772): Launched 13:54:45.585176 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:46.180182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28774): Launched 13:54:46.505701 run osmo-stp_10.42.42.5(pid=28775): Launched 13:54:46.710883 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:47.400887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28777): Launched 13:54:47.728642 run osmo-msc_10.42.42.6(pid=28778): Launched 13:54:47.910726 run osmo-stp_10.42.42.5(pid=28775): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28775)] 13:54:48.047239 run osmo-stp_10.42.42.5(pid=28775): stdout: | (launched: 2022-12-13_13:54:46.445076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:48.185640 run osmo-stp_10.42.42.5(pid=28775): stderr: | 20221213135446738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135446738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135446739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135446739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135446740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135446740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135446740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:48.315414 run osmo-stp_10.42.42.5(pid=28775): stdout: | (launched: 2022-12-13_13:54:46.445076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:48.435449 run osmo-stp_10.42.42.5(pid=28775): stderr: | 20221213135446738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135446738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135446739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135446739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135446740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135446740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135446740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:48.579832 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28775): Process ended prematurely: osmo-stp_10.42.42.5(pid=28775) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28775)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:54:48.588934 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:54:48.615377 run osmo-hlr_10.42.42.2(pid=28772): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28772)] 13:54:48.662535 run osmo-hlr_10.42.42.2(pid=28772): stdout: | (launched: 2022-12-13_13:54:45.399128) 13:54:48.711505 run osmo-hlr_10.42.42.2(pid=28772): stderr: | 20221213135445596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135445596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135445596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135445596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135445596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135445596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135445608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135445616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135445616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135445616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:48.780033 run osmo-msc_10.42.42.6(pid=28778): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28778)] 13:54:48.827361 run osmo-msc_10.42.42.6(pid=28778): stdout: | (launched: 2022-12-13_13:54:47.668222) 13:54:48.876138 run osmo-msc_10.42.42.6(pid=28778): stderr: | 20221213135447990 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135447990 DLGLOBAL DEBUG validating counter group 0x7f97c0117c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135447991 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135447991 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135447991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135447991 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135447993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135447993 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135447993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135447993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:48.925188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28771): Terminating (SIGTERM) 13:54:48.964635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28774): Terminating (SIGTERM) 13:54:49.004185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28777): Terminating (SIGTERM) 13:54:49.043936 --- ParallelTerminationStrategy: PID 28771 died... 13:54:49.063077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28771): Terminated: ok {rc=0} 13:54:49.106775 --- ParallelTerminationStrategy: PID 28774 died... 13:54:49.125332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28774): Terminated: ok {rc=0} 13:54:49.169020 --- ParallelTerminationStrategy: PID 28777 died... 13:54:49.187997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28777): Terminated: ok {rc=0} 13:54:49.271124 bus /sierra_3: Setting Powered False 13:54:50.368627 bus /sierra_3: Setting Powered False 13:54:51.486988 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:54:52.637661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:52.650288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:54:52.720345 tst mo_mt_call_osmux.py: using LAC 34398 13:54:52.848384 tst mo_mt_call_osmux.py: using RAC 228 13:54:52.975502 tst mo_mt_call_osmux.py: using CellId 34398 13:54:53.104408 tst mo_mt_call_osmux.py: using BVCI 34399 13:54:53.222859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:53.234836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:53.246503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:53.258107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:53.270331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:53.282490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:53.400343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:53.521191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:54.026828 run create_hlr_db(pid=28780): Launched 13:54:54.151575 bus /sierra_2: Setting Powered False 13:54:55.215590 run create_hlr_db(pid=28780): Terminated: ok {rc=0} 13:54:55.652762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28782): Launched 13:54:55.958881 run osmo-hlr_10.42.42.2(pid=28783): Launched 13:54:56.073533 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:56.614532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28785): Launched 13:54:56.921178 run osmo-stp_10.42.42.5(pid=28786): Launched 13:54:57.036246 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:57.590018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28788): Launched 13:54:57.896702 run osmo-msc_10.42.42.6(pid=28789): Launched 13:54:58.066018 run osmo-stp_10.42.42.5(pid=28786): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28786)] 13:54:58.194437 run osmo-stp_10.42.42.5(pid=28786): stdout: | (launched: 2022-12-13_13:54:56.864244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:58.322683 run osmo-stp_10.42.42.5(pid=28786): stderr: | 20221213135457033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135457033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135457034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135457034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135457034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135457034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135457035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:58.449217 run osmo-stp_10.42.42.5(pid=28786): stdout: | (launched: 2022-12-13_13:54:56.864244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:58.568822 run osmo-stp_10.42.42.5(pid=28786): stderr: | 20221213135457033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135457033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135457034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135457034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135457034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135457034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135457035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:58.712559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28786): Process ended prematurely: osmo-stp_10.42.42.5(pid=28786) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28786)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:54:58.721522 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:54:58.749359 run osmo-hlr_10.42.42.2(pid=28783): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28783)] 13:54:58.796777 run osmo-hlr_10.42.42.2(pid=28783): stdout: | (launched: 2022-12-13_13:54:55.901512) 13:54:58.845619 run osmo-hlr_10.42.42.2(pid=28783): stderr: | 20221213135456076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135456077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135456077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135456077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135456077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135456077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135456088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135456097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135456097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135456097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:58.913805 run osmo-msc_10.42.42.6(pid=28789): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28789)] 13:54:58.960774 run osmo-msc_10.42.42.6(pid=28789): stdout: | (launched: 2022-12-13_13:54:57.839813) 13:54:59.009367 run osmo-msc_10.42.42.6(pid=28789): stderr: | 20221213135458112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135458113 DLGLOBAL DEBUG validating counter group 0x7fa583641c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135458113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135458113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135458113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135458113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135458115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135458115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135458115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135458115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:59.058442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28782): Terminating (SIGTERM) 13:54:59.097707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28785): Terminating (SIGTERM) 13:54:59.137140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28788): Terminating (SIGTERM) 13:54:59.176659 --- ParallelTerminationStrategy: PID 28782 died... 13:54:59.195809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28782): Terminated: ok {rc=0} 13:54:59.239567 --- ParallelTerminationStrategy: PID 28785 died... 13:54:59.258298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28785): Terminated: ok {rc=0} 13:54:59.302023 --- ParallelTerminationStrategy: PID 28788 died... 13:54:59.320707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28788): Terminated: ok {rc=0} 13:54:59.405574 bus /sierra_3: Setting Powered False 13:55:00.504018 bus /sierra_3: Setting Powered False 13:55:01.627109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:55:02.889056 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:02.897845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:55:02.927489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:55:02.955993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:55:03.013377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:55:03.042462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:55:03.069255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:55:03.619936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:55:03.669981 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:03.681418 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:55:03.746999 tst mo_mt_call.py: using LAC 34399 13:55:03.865110 tst mo_mt_call.py: using RAC 229 13:55:03.984513 tst mo_mt_call.py: using CellId 34399 13:55:04.106085 tst mo_mt_call.py: using BVCI 34400 13:55:04.216327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:04.227532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:04.238536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:04.249662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:04.260797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:04.272059 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:55:04.391961 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:55:04.511334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:05.015731 run create_hlr_db(pid=28797): Launched 13:55:05.142213 bus /sierra_2: Setting Powered False 13:55:06.206096 run create_hlr_db(pid=28797): Terminated: ok {rc=0} 13:55:06.639784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28799): Launched 13:55:06.945270 run osmo-hlr_10.42.42.2(pid=28800): Launched 13:55:07.060186 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:07.586519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28802): Launched 13:55:07.891974 run osmo-stp_10.42.42.5(pid=28803): Launched 13:55:08.007336 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:08.557562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28805): Launched 13:55:08.864423 run osmo-msc_10.42.42.6(pid=28806): Launched 13:55:09.035262 run osmo-stp_10.42.42.5(pid=28803): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28803)] 13:55:09.162905 run osmo-stp_10.42.42.5(pid=28803): stdout: | (launched: 2022-12-13_13:55:07.835279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:09.291003 run osmo-stp_10.42.42.5(pid=28803): stderr: | 20221213135508005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135508006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135508006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135508006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135508007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135508007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135508007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:09.417932 run osmo-stp_10.42.42.5(pid=28803): stdout: | (launched: 2022-12-13_13:55:07.835279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:09.538249 run osmo-stp_10.42.42.5(pid=28803): stderr: | 20221213135508005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135508006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135508006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135508006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135508007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135508007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135508007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:09.683462 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28803): Process ended prematurely: osmo-stp_10.42.42.5(pid=28803) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28803)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:55:09.692664 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:55:09.719271 run osmo-hlr_10.42.42.2(pid=28800): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28800)] 13:55:09.766834 run osmo-hlr_10.42.42.2(pid=28800): stdout: | (launched: 2022-12-13_13:55:06.888574) 13:55:09.815613 run osmo-hlr_10.42.42.2(pid=28800): stderr: | 20221213135507066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135507066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135507066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135507066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135507066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135507066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135507078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135507089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135507089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135507089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:09.884013 run osmo-msc_10.42.42.6(pid=28806): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28806)] 13:55:09.930878 run osmo-msc_10.42.42.6(pid=28806): stdout: | (launched: 2022-12-13_13:55:08.807087) 13:55:09.979230 run osmo-msc_10.42.42.6(pid=28806): stderr: | 20221213135509080 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135509080 DLGLOBAL DEBUG validating counter group 0x7fe555dc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135509080 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135509081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135509081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135509081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135509083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135509083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135509083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135509083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:10.028006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28799): Terminating (SIGTERM) 13:55:10.067420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28802): Terminating (SIGTERM) 13:55:10.106718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28805): Terminating (SIGTERM) 13:55:10.146415 --- ParallelTerminationStrategy: PID 28799 died... 13:55:10.165481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28799): Terminated: ok {rc=0} 13:55:10.209208 --- ParallelTerminationStrategy: PID 28802 died... 13:55:10.227978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28802): Terminated: ok {rc=0} 13:55:10.271584 --- ParallelTerminationStrategy: PID 28805 died... 13:55:10.290380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28805): Terminated: ok {rc=0} 13:55:10.373091 bus /sierra_3: Setting Powered False 13:55:11.470193 bus /sierra_3: Setting Powered False 13:55:12.586020 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:55:13.729658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:13.741797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:55:13.809887 tst mo_mt_call_osmux.py: using LAC 34400 13:55:13.930414 tst mo_mt_call_osmux.py: using RAC 230 13:55:14.050467 tst mo_mt_call_osmux.py: using CellId 34400 13:55:14.171621 tst mo_mt_call_osmux.py: using BVCI 34401 13:55:14.283870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:14.295450 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:14.306537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:14.317805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:14.329138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:55:14.340227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:55:14.456033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:55:14.576634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:15.084018 run create_hlr_db(pid=28808): Launched 13:55:15.211365 bus /sierra_2: Setting Powered False 13:55:16.290900 run create_hlr_db(pid=28808): Terminated: ok {rc=0} 13:55:16.731979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Launched 13:55:17.058904 run osmo-hlr_10.42.42.2(pid=28811): Launched 13:55:17.234168 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:17.802799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Launched 13:55:18.130479 run osmo-stp_10.42.42.5(pid=28814): Launched 13:55:18.256079 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:18.846237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Launched 13:55:19.175179 run osmo-msc_10.42.42.6(pid=28817): Launched 13:55:19.361393 run osmo-stp_10.42.42.5(pid=28814): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] 13:55:19.499552 run osmo-stp_10.42.42.5(pid=28814): stdout: | (launched: 2022-12-13_13:55:18.070015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:19.638911 run osmo-stp_10.42.42.5(pid=28814): stderr: | 20221213135518261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135518261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135518262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135518262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135518262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135518263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135518263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:19.777046 run osmo-stp_10.42.42.5(pid=28814): stdout: | (launched: 2022-12-13_13:55:18.070015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:19.906981 run osmo-stp_10.42.42.5(pid=28814): stderr: | 20221213135518261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135518261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135518262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135518262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135518262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135518263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135518263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:20.062450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28814): Process ended prematurely: osmo-stp_10.42.42.5(pid=28814) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:55:20.072146 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:55:20.100418 run osmo-hlr_10.42.42.2(pid=28811): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28811)] 13:55:20.150965 run osmo-hlr_10.42.42.2(pid=28811): stdout: | (launched: 2022-12-13_13:55:17.000808) 13:55:20.203004 run osmo-hlr_10.42.42.2(pid=28811): stderr: | 20221213135517254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135517254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135517254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135517254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135517254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135517254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135517267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135517275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135517275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135517275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:20.275229 run osmo-msc_10.42.42.6(pid=28817): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28817)] 13:55:20.324526 run osmo-msc_10.42.42.6(pid=28817): stdout: | (launched: 2022-12-13_13:55:19.114610) 13:55:20.376214 run osmo-msc_10.42.42.6(pid=28817): stderr: | 20221213135519438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135519438 DLGLOBAL DEBUG validating counter group 0x7f5aa5c80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135519438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135519438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135519439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135519439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135519441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135519441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135519441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135519441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:20.428148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Terminating (SIGTERM) 13:55:20.470246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Terminating (SIGTERM) 13:55:20.512114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Terminating (SIGTERM) 13:55:20.554657 --- ParallelTerminationStrategy: PID 28810 died... 13:55:20.575241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Terminated: ok {rc=0} 13:55:20.621713 --- ParallelTerminationStrategy: PID 28813 died... 13:55:20.641724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Terminated: ok {rc=0} 13:55:20.688320 --- ParallelTerminationStrategy: PID 28816 died... 13:55:20.708073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Terminated: ok {rc=0} 13:55:20.797028 bus /sierra_3: Setting Powered False 13:55:21.895308 bus /sierra_3: Setting Powered False 13:55:23.013646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:55:24.259523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:24.266586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:55:24.295876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:55:24.323032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:55:24.376137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:55:24.405526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:55:24.431883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:55:24.986807 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:55:25.039938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.051935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:55:25.118085 tst mo_mt_call.py: using LAC 34401 13:55:25.244903 tst mo_mt_call.py: using RAC 231 13:55:25.371464 tst mo_mt_call.py: using CellId 34401 13:55:25.498248 tst mo_mt_call.py: using BVCI 34402 13:55:25.610574 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.621916 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.633054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.644028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.655152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:25.666270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:25.782471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:25.902202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:26.408241 run create_hlr_db(pid=28822): Launched 13:55:26.535106 bus /sierra_2: Setting Powered False 13:55:27.608158 run create_hlr_db(pid=28822): Terminated: ok {rc=0} 13:55:28.063387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Launched 13:55:28.394027 run osmo-hlr_10.42.42.2(pid=28825): Launched 13:55:28.519119 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:29.083568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Launched 13:55:29.411064 run osmo-stp_10.42.42.5(pid=28828): Launched 13:55:29.536809 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:30.135284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28830): Launched 13:55:30.463190 run osmo-msc_10.42.42.6(pid=28831): Launched 13:55:30.647322 run osmo-stp_10.42.42.5(pid=28828): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] 13:55:30.785880 run osmo-stp_10.42.42.5(pid=28828): stdout: | (launched: 2022-12-13_13:55:29.350742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:31.034710 run osmo-stp_10.42.42.5(pid=28828): stderr: | 20221213135529543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135529543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135529543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135529544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135529544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135529544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135529544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:31.181539 run osmo-stp_10.42.42.5(pid=28828): stdout: | (launched: 2022-12-13_13:55:29.350742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:31.314884 run osmo-stp_10.42.42.5(pid=28828): stderr: | 20221213135529543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135529543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135529543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135529544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135529544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135529544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135529544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:31.473764 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28828): Process ended prematurely: osmo-stp_10.42.42.5(pid=28828) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:55:31.484377 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:55:31.513476 run osmo-hlr_10.42.42.2(pid=28825): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28825)] 13:55:31.566469 run osmo-hlr_10.42.42.2(pid=28825): stdout: | (launched: 2022-12-13_13:55:28.332618) 13:55:31.621409 run osmo-hlr_10.42.42.2(pid=28825): stderr: | 20221213135528530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135528530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135528530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135528530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135528530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135528530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135528542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135528552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135528552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135528552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:31.696400 run osmo-msc_10.42.42.6(pid=28831): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28831)] 13:55:31.748419 run osmo-msc_10.42.42.6(pid=28831): stdout: | (launched: 2022-12-13_13:55:30.402543) 13:55:31.802387 run osmo-msc_10.42.42.6(pid=28831): stderr: | 20221213135530723 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135530723 DLGLOBAL DEBUG validating counter group 0x7fb5929f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135530723 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135530723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135530723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135530723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135530725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135530726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135530726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135530726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:31.856561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Terminating (SIGTERM) 13:55:31.899507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Terminating (SIGTERM) 13:55:31.943545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28830): Terminating (SIGTERM) 13:55:31.988164 --- ParallelTerminationStrategy: PID 28824 died... 13:55:32.010108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Terminated: ok {rc=0} 13:55:32.058730 --- ParallelTerminationStrategy: PID 28827 died... 13:55:32.079929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Terminated: ok {rc=0} 13:55:32.128170 --- ParallelTerminationStrategy: PID 28830 died... 13:55:32.149463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28830): Terminated: ok {rc=0} 13:55:32.242285 bus /sierra_3: Setting Powered False 13:55:33.341801 bus /sierra_3: Setting Powered False 13:55:34.456432 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:55:35.602323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:35.614336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:55:35.680804 tst mo_mt_call_osmux.py: using LAC 34402 13:55:35.801914 tst mo_mt_call_osmux.py: using RAC 232 13:55:35.925002 tst mo_mt_call_osmux.py: using CellId 34402 13:55:36.045258 tst mo_mt_call_osmux.py: using BVCI 34403 13:55:36.156693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:36.167985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:36.178990 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:36.190043 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:36.201165 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:36.212143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:36.326945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:36.449438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:36.932352 run create_hlr_db(pid=28833): Launched 13:55:37.059059 bus /sierra_2: Setting Powered False 13:55:38.123077 run create_hlr_db(pid=28833): Terminated: ok {rc=0} 13:55:38.559230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28835): Launched 13:55:38.863426 run osmo-hlr_10.42.42.2(pid=28836): Launched 13:55:38.978477 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:39.517500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28838): Launched 13:55:39.824039 run osmo-stp_10.42.42.5(pid=28839): Launched 13:55:39.939870 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:40.493810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28841): Launched 13:55:40.803980 run osmo-msc_10.42.42.6(pid=28842): Launched 13:55:40.974366 run osmo-stp_10.42.42.5(pid=28839): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28839)] 13:55:41.103094 run osmo-stp_10.42.42.5(pid=28839): stdout: | (launched: 2022-12-13_13:55:39.767092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:41.230831 run osmo-stp_10.42.42.5(pid=28839): stderr: | 20221213135539934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135539934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135539934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135539935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135539935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135539935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135539935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:41.356680 run osmo-stp_10.42.42.5(pid=28839): stdout: | (launched: 2022-12-13_13:55:39.767092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:41.476475 run osmo-stp_10.42.42.5(pid=28839): stderr: | 20221213135539934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135539934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135539934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135539935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135539935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135539935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135539935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:41.619962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28839): Process ended prematurely: osmo-stp_10.42.42.5(pid=28839) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28839)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:55:41.629049 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:55:41.655677 run osmo-hlr_10.42.42.2(pid=28836): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28836)] 13:55:41.703188 run osmo-hlr_10.42.42.2(pid=28836): stdout: | (launched: 2022-12-13_13:55:38.806779) 13:55:41.752207 run osmo-hlr_10.42.42.2(pid=28836): stderr: | 20221213135538983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135538983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135538983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135538983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135538983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135538983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135538995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135539005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135539005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135539005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:41.820640 run osmo-msc_10.42.42.6(pid=28842): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28842)] 13:55:41.868272 run osmo-msc_10.42.42.6(pid=28842): stdout: | (launched: 2022-12-13_13:55:40.747295) 13:55:41.917462 run osmo-msc_10.42.42.6(pid=28842): stderr: | 20221213135541017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135541017 DLGLOBAL DEBUG validating counter group 0x7efc722fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135541017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135541018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135541018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135541018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135541020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135541020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135541020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135541020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:41.966589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28835): Terminating (SIGTERM) 13:55:42.006042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28838): Terminating (SIGTERM) 13:55:42.045515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28841): Terminating (SIGTERM) 13:55:42.085276 --- ParallelTerminationStrategy: PID 28835 died... 13:55:42.104443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28835): Terminated: ok {rc=0} 13:55:42.148182 --- ParallelTerminationStrategy: PID 28838 died... 13:55:42.167084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28838): Terminated: ok {rc=0} 13:55:42.210702 --- ParallelTerminationStrategy: PID 28841 died... 13:55:42.229438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28841): Terminated: ok {rc=0} 13:55:42.315041 bus /sierra_3: Setting Powered False 13:55:43.413358 bus /sierra_3: Setting Powered False 13:55:44.525292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:55:45.773324 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:45.780249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:55:45.810219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:55:45.839229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:55:45.895426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:55:45.931947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:55:45.962378 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:55:46.521098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:55:46.605580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:46.620448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:55:46.689877 tst mo_mt_call.py: using LAC 34403 13:55:46.828110 tst mo_mt_call.py: using RAC 233 13:55:46.954851 tst mo_mt_call.py: using CellId 34403 13:55:47.076290 tst mo_mt_call.py: using BVCI 34404 13:55:47.203478 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:47.216091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:47.228414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:47.240646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:47.253680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:47.266770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:55:47.395542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:55:47.512931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:47.984873 run create_hlr_db(pid=28848): Launched 13:55:48.109155 bus /sierra_2: Setting Powered False 13:55:49.169960 run create_hlr_db(pid=28848): Terminated: ok {rc=0} 13:55:49.595841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28850): Launched 13:55:49.904461 run osmo-hlr_10.42.42.2(pid=28851): Launched 13:55:50.021768 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:50.559314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28853): Launched 13:55:50.865307 run osmo-stp_10.42.42.5(pid=28854): Launched 13:55:50.981277 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:51.529857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28856): Launched 13:55:51.840628 run osmo-msc_10.42.42.6(pid=28857): Launched 13:55:52.020432 run osmo-stp_10.42.42.5(pid=28854): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28854)] 13:55:52.150079 run osmo-stp_10.42.42.5(pid=28854): stdout: | (launched: 2022-12-13_13:55:50.808288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:52.278734 run osmo-stp_10.42.42.5(pid=28854): stderr: | 20221213135550977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135550978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135550978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135550978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135550979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135550979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135550979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:52.405614 run osmo-stp_10.42.42.5(pid=28854): stdout: | (launched: 2022-12-13_13:55:50.808288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:52.526278 run osmo-stp_10.42.42.5(pid=28854): stderr: | 20221213135550977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135550978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135550978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135550978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135550979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135550979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135550979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:52.671348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28854): Process ended prematurely: osmo-stp_10.42.42.5(pid=28854) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28854)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:55:52.680517 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:55:52.707225 run osmo-hlr_10.42.42.2(pid=28851): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28851)] 13:55:52.754846 run osmo-hlr_10.42.42.2(pid=28851): stdout: | (launched: 2022-12-13_13:55:49.847121) 13:55:52.803700 run osmo-hlr_10.42.42.2(pid=28851): stderr: | 20221213135550023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135550023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135550023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135550023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135550023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135550023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135550035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135550046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135550046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135550047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:52.872477 run osmo-msc_10.42.42.6(pid=28857): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28857)] 13:55:52.919825 run osmo-msc_10.42.42.6(pid=28857): stdout: | (launched: 2022-12-13_13:55:51.781303) 13:55:52.968501 run osmo-msc_10.42.42.6(pid=28857): stderr: | 20221213135552055 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135552055 DLGLOBAL DEBUG validating counter group 0x7f0ba6108c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135552055 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135552055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135552055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135552056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135552057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135552058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135552058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135552058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:53.017648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28850): Terminating (SIGTERM) 13:55:53.057123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28853): Terminating (SIGTERM) 13:55:53.096592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28856): Terminating (SIGTERM) 13:55:53.136451 --- ParallelTerminationStrategy: PID 28850 died... 13:55:53.155729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28850): Terminated: ok {rc=0} 13:55:53.199708 --- ParallelTerminationStrategy: PID 28853 died... 13:55:53.218577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28853): Terminated: ok {rc=0} 13:55:53.262409 --- ParallelTerminationStrategy: PID 28856 died... 13:55:53.280937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28856): Terminated: ok {rc=0} 13:55:53.366266 bus /sierra_3: Setting Powered False 13:55:54.466582 bus /sierra_3: Setting Powered False 13:55:55.583688 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:55:56.735808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:56.748187 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:55:56.816065 tst mo_mt_call_osmux.py: using LAC 34404 13:55:56.943534 tst mo_mt_call_osmux.py: using RAC 234 13:55:57.071486 tst mo_mt_call_osmux.py: using CellId 34404 13:55:57.193286 tst mo_mt_call_osmux.py: using BVCI 34405 13:55:57.312851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:57.325096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:57.336887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:57.348808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:57.361550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:55:57.373634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:55:57.492175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:55:57.607881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:58.079610 run create_hlr_db(pid=28862): Launched 13:55:58.206018 bus /sierra_2: Setting Powered False 13:55:59.267095 run create_hlr_db(pid=28862): Terminated: ok {rc=0} 13:55:59.710997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Launched 13:56:00.040152 run osmo-hlr_10.42.42.2(pid=28865): Launched 13:56:00.165297 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:00.732168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Launched 13:56:01.084592 run osmo-stp_10.42.42.5(pid=28868): Launched 13:56:01.374800 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:01.977018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Launched 13:56:02.319200 run osmo-msc_10.42.42.6(pid=28871): Launched 13:56:02.503031 run osmo-stp_10.42.42.5(pid=28868): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] 13:56:02.641054 run osmo-stp_10.42.42.5(pid=28868): stdout: | (launched: 2022-12-13_13:56:01.023853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:02.780062 run osmo-stp_10.42.42.5(pid=28868): stderr: | 20221213135601297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135601297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135601297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135601298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135601298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135601298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135601298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:02.915901 run osmo-stp_10.42.42.5(pid=28868): stdout: | (launched: 2022-12-13_13:56:01.023853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:03.045343 run osmo-stp_10.42.42.5(pid=28868): stderr: | 20221213135601297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135601297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135601297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135601298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135601298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135601298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135601298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:03.200235 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28868): Process ended prematurely: osmo-stp_10.42.42.5(pid=28868) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:56:03.209994 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:56:03.237887 run osmo-hlr_10.42.42.2(pid=28865): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28865)] 13:56:03.288645 run osmo-hlr_10.42.42.2(pid=28865): stdout: | (launched: 2022-12-13_13:55:59.978789) 13:56:03.340542 run osmo-hlr_10.42.42.2(pid=28865): stderr: | 20221213135600177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135600177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135600177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135600177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135600177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135600177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135600188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135600197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135600197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135600197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:03.412653 run osmo-msc_10.42.42.6(pid=28871): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28871)] 13:56:03.462180 run osmo-msc_10.42.42.6(pid=28871): stdout: | (launched: 2022-12-13_13:56:02.258777) 13:56:03.514090 run osmo-msc_10.42.42.6(pid=28871): stderr: | 20221213135602579 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135602579 DLGLOBAL DEBUG validating counter group 0x7f1a12467c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135602579 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135602579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135602579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135602579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135602581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135602582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135602582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135602582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:03.566509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Terminating (SIGTERM) 13:56:03.607967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Terminating (SIGTERM) 13:56:03.650055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Terminating (SIGTERM) 13:56:03.692416 --- ParallelTerminationStrategy: PID 28864 died... 13:56:03.713398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Terminated: ok {rc=0} 13:56:03.759759 --- ParallelTerminationStrategy: PID 28867 died... 13:56:03.779780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Terminated: ok {rc=0} 13:56:03.826118 --- ParallelTerminationStrategy: PID 28870 died... 13:56:03.846190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Terminated: ok {rc=0} 13:56:03.934270 bus /sierra_3: Setting Powered False 13:56:05.032621 bus /sierra_3: Setting Powered False 13:56:06.147813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:56:07.393910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:07.400296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:56:07.429282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:56:07.456159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:56:07.507615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:56:07.536119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:56:07.562871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:56:08.121109 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:56:08.171210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.182581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:56:08.248380 tst mo_mt_call.py: using LAC 34405 13:56:08.370645 tst mo_mt_call.py: using RAC 235 13:56:08.492824 tst mo_mt_call.py: using CellId 34405 13:56:08.613666 tst mo_mt_call.py: using BVCI 34406 13:56:08.723927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.735210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.746288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.757346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.768882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:08.780441 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:56:08.901118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:56:09.024925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:09.528871 run create_hlr_db(pid=28876): Launched 13:56:09.656013 bus /sierra_2: Setting Powered False 13:56:10.720285 run create_hlr_db(pid=28876): Terminated: ok {rc=0} 13:56:11.155856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28878): Launched 13:56:11.461818 run osmo-hlr_10.42.42.2(pid=28879): Launched 13:56:11.577218 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:12.100890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28881): Launched 13:56:12.406969 run osmo-stp_10.42.42.5(pid=28882): Launched 13:56:12.523163 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:13.072710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28884): Launched 13:56:13.379952 run osmo-msc_10.42.42.6(pid=28885): Launched 13:56:13.549884 run osmo-stp_10.42.42.5(pid=28882): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28882)] 13:56:13.678192 run osmo-stp_10.42.42.5(pid=28882): stdout: | (launched: 2022-12-13_13:56:12.350136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:13.807041 run osmo-stp_10.42.42.5(pid=28882): stderr: | 20221213135612519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135612519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135612520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135612520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135612521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135612521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135612521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:13.933696 run osmo-stp_10.42.42.5(pid=28882): stdout: | (launched: 2022-12-13_13:56:12.350136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:14.054267 run osmo-stp_10.42.42.5(pid=28882): stderr: | 20221213135612519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135612519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135612520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135612520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135612521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135612521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135612521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:14.199315 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28882): Process ended prematurely: osmo-stp_10.42.42.5(pid=28882) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28882)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:56:14.208177 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:56:14.234587 run osmo-hlr_10.42.42.2(pid=28879): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28879)] 13:56:14.282155 run osmo-hlr_10.42.42.2(pid=28879): stdout: | (launched: 2022-12-13_13:56:11.404694) 13:56:14.330814 run osmo-hlr_10.42.42.2(pid=28879): stderr: | 20221213135611581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135611581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135611581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135611581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135611581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135611581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135611593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135611602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135611602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135611602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:14.399062 run osmo-msc_10.42.42.6(pid=28885): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28885)] 13:56:14.445742 run osmo-msc_10.42.42.6(pid=28885): stdout: | (launched: 2022-12-13_13:56:13.322577) 13:56:14.493973 run osmo-msc_10.42.42.6(pid=28885): stderr: | 20221213135613592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135613593 DLGLOBAL DEBUG validating counter group 0x7f943e7adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135613593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135613593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135613593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135613593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135613595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135613595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135613595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135613596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:14.542736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28878): Terminating (SIGTERM) 13:56:14.582194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28881): Terminating (SIGTERM) 13:56:14.621216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28884): Terminating (SIGTERM) 13:56:14.660632 --- ParallelTerminationStrategy: PID 28878 died... 13:56:14.679863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28878): Terminated: ok {rc=0} 13:56:14.723475 --- ParallelTerminationStrategy: PID 28881 died... 13:56:14.742123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28881): Terminated: ok {rc=0} 13:56:14.785361 --- ParallelTerminationStrategy: PID 28884 died... 13:56:14.804026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28884): Terminated: ok {rc=0} 13:56:14.888708 bus /sierra_3: Setting Powered False 13:56:15.988617 bus /sierra_3: Setting Powered False 13:56:17.116400 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:56:18.271660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.283992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:56:18.352325 tst mo_mt_call_osmux.py: using LAC 34406 13:56:18.481146 tst mo_mt_call_osmux.py: using RAC 236 13:56:18.607526 tst mo_mt_call_osmux.py: using CellId 34406 13:56:18.737828 tst mo_mt_call_osmux.py: using BVCI 34407 13:56:18.849984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.861523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.872844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.884103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.895542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:56:18.906964 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:56:19.027849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:56:19.146092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:19.619783 run create_hlr_db(pid=28887): Launched 13:56:19.743546 bus /sierra_2: Setting Powered False 13:56:20.803628 run create_hlr_db(pid=28887): Terminated: ok {rc=0} 13:56:21.228356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28889): Launched 13:56:21.533463 run osmo-hlr_10.42.42.2(pid=28890): Launched 13:56:21.649210 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:22.187541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28892): Launched 13:56:22.494238 run osmo-stp_10.42.42.5(pid=28893): Launched 13:56:22.610586 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:23.160281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28895): Launched 13:56:23.464468 run osmo-msc_10.42.42.6(pid=28896): Launched 13:56:23.636182 run osmo-stp_10.42.42.5(pid=28893): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28893)] 13:56:23.765252 run osmo-stp_10.42.42.5(pid=28893): stdout: | (launched: 2022-12-13_13:56:22.437268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:23.892865 run osmo-stp_10.42.42.5(pid=28893): stderr: | 20221213135622607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135622607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135622607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135622608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135622608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135622608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135622608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:24.018909 run osmo-stp_10.42.42.5(pid=28893): stdout: | (launched: 2022-12-13_13:56:22.437268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:24.138739 run osmo-stp_10.42.42.5(pid=28893): stderr: | 20221213135622607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135622607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135622607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135622608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135622608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135622608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135622608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:24.283359 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28893): Process ended prematurely: osmo-stp_10.42.42.5(pid=28893) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28893)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:56:24.292420 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:56:24.318937 run osmo-hlr_10.42.42.2(pid=28890): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28890)] 13:56:24.366296 run osmo-hlr_10.42.42.2(pid=28890): stdout: | (launched: 2022-12-13_13:56:21.476215) 13:56:24.415043 run osmo-hlr_10.42.42.2(pid=28890): stderr: | 20221213135621654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135621654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135621654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135621654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135621654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135621654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135621664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135621674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135621674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135621674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:24.483159 run osmo-msc_10.42.42.6(pid=28896): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28896)] 13:56:24.530255 run osmo-msc_10.42.42.6(pid=28896): stdout: | (launched: 2022-12-13_13:56:23.407786) 13:56:24.578756 run osmo-msc_10.42.42.6(pid=28896): stderr: | 20221213135623677 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135623678 DLGLOBAL DEBUG validating counter group 0x7faf6172fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135623678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135623678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135623678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135623678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135623680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135623680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135623680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135623680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:24.627937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28889): Terminating (SIGTERM) 13:56:24.667365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28892): Terminating (SIGTERM) 13:56:24.706648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28895): Terminating (SIGTERM) 13:56:24.746483 --- ParallelTerminationStrategy: PID 28889 died... 13:56:24.765711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28889): Terminated: ok {rc=0} 13:56:24.809531 --- ParallelTerminationStrategy: PID 28892 died... 13:56:24.828195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28892): Terminated: ok {rc=0} 13:56:24.871584 --- ParallelTerminationStrategy: PID 28895 died... 13:56:24.890372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28895): Terminated: ok {rc=0} 13:56:24.973170 bus /sierra_3: Setting Powered False 13:56:26.069918 bus /sierra_3: Setting Powered False 13:56:27.187370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:56:28.430401 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:28.438055 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:56:28.467881 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:56:28.496739 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:56:28.551545 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:56:28.580573 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:56:28.607254 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:56:29.158744 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:56:29.208377 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.219978 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:56:29.285320 tst mo_mt_call.py: using LAC 34407 13:56:29.405365 tst mo_mt_call.py: using RAC 237 13:56:29.525623 tst mo_mt_call.py: using CellId 34407 13:56:29.644492 tst mo_mt_call.py: using BVCI 34408 13:56:29.755696 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.767428 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.778778 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.790181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.801854 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:29.813340 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:29.934832 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:30.053075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:30.561278 run create_hlr_db(pid=28901): Launched 13:56:30.687705 bus /sierra_2: Setting Powered False 13:56:31.765330 run create_hlr_db(pid=28901): Terminated: ok {rc=0} 13:56:32.236144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Launched 13:56:32.545812 run osmo-hlr_10.42.42.2(pid=28904): Launched 13:56:32.662008 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:33.186646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Launched 13:56:33.494370 run osmo-stp_10.42.42.5(pid=28907): Launched 13:56:33.611967 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:34.163742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28909): Launched 13:56:34.472647 run osmo-msc_10.42.42.6(pid=28910): Launched 13:56:34.642972 run osmo-stp_10.42.42.5(pid=28907): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] 13:56:34.771731 run osmo-stp_10.42.42.5(pid=28907): stdout: | (launched: 2022-12-13_13:56:33.437064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:34.900836 run osmo-stp_10.42.42.5(pid=28907): stderr: | 20221213135633606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135633606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135633607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135633607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135633607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135633608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135633608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:35.028176 run osmo-stp_10.42.42.5(pid=28907): stdout: | (launched: 2022-12-13_13:56:33.437064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:35.149637 run osmo-stp_10.42.42.5(pid=28907): stderr: | 20221213135633606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135633606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135633607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135633607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135633607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135633608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135633608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:35.294600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28907): Process ended prematurely: osmo-stp_10.42.42.5(pid=28907) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:56:35.303667 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:56:35.330479 run osmo-hlr_10.42.42.2(pid=28904): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28904)] 13:56:35.378496 run osmo-hlr_10.42.42.2(pid=28904): stdout: | (launched: 2022-12-13_13:56:32.488313) 13:56:35.427751 run osmo-hlr_10.42.42.2(pid=28904): stderr: | 20221213135632664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135632665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135632665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135632665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135632665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135632665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135632680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135632689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135632689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135632689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:35.497175 run osmo-msc_10.42.42.6(pid=28910): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28910)] 13:56:35.544655 run osmo-msc_10.42.42.6(pid=28910): stdout: | (launched: 2022-12-13_13:56:34.415445) 13:56:35.593970 run osmo-msc_10.42.42.6(pid=28910): stderr: | 20221213135634687 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135634687 DLGLOBAL DEBUG validating counter group 0x7fd84f08fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135634687 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135634687 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135634687 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135634688 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135634689 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135634690 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135634690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135634690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:35.643514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Terminating (SIGTERM) 13:56:35.683236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Terminating (SIGTERM) 13:56:35.723007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28909): Terminating (SIGTERM) 13:56:35.763164 --- ParallelTerminationStrategy: PID 28903 died... 13:56:35.782636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28903): Terminated: ok {rc=0} 13:56:35.827194 --- ParallelTerminationStrategy: PID 28906 died... 13:56:35.846323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28906): Terminated: ok {rc=0} 13:56:35.890596 --- ParallelTerminationStrategy: PID 28909 died... 13:56:35.909696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28909): Terminated: ok {rc=0} 13:56:35.995888 bus /sierra_3: Setting Powered False 13:56:37.095957 bus /sierra_3: Setting Powered False 13:56:38.209407 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:56:39.359423 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.371784 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:56:39.440494 tst mo_mt_call_osmux.py: using LAC 34408 13:56:39.568111 tst mo_mt_call_osmux.py: using RAC 238 13:56:39.695967 tst mo_mt_call_osmux.py: using CellId 34408 13:56:39.824473 tst mo_mt_call_osmux.py: using BVCI 34409 13:56:39.936642 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.948283 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.960614 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.971981 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.983696 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:39.995220 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:40.112552 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:40.234589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:40.741030 run create_hlr_db(pid=28912): Launched 13:56:40.866760 bus /sierra_2: Setting Powered False 13:56:41.930820 run create_hlr_db(pid=28912): Terminated: ok {rc=0} 13:56:42.368611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28914): Launched 13:56:42.677932 run osmo-hlr_10.42.42.2(pid=28915): Launched 13:56:42.793514 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:43.317035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28917): Launched 13:56:43.622276 run osmo-stp_10.42.42.5(pid=28918): Launched 13:56:43.740174 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:44.290093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28920): Launched 13:56:44.598940 run osmo-msc_10.42.42.6(pid=28921): Launched 13:56:44.769716 run osmo-stp_10.42.42.5(pid=28918): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28918)] 13:56:44.897215 run osmo-stp_10.42.42.5(pid=28918): stdout: | (launched: 2022-12-13_13:56:43.565208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:45.025126 run osmo-stp_10.42.42.5(pid=28918): stderr: | 20221213135643734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135643734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135643734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135643735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135643735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135643735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135643735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:45.151638 run osmo-stp_10.42.42.5(pid=28918): stdout: | (launched: 2022-12-13_13:56:43.565208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:45.272049 run osmo-stp_10.42.42.5(pid=28918): stderr: | 20221213135643734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135643734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135643734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135643735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135643735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135643735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135643735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:45.416138 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28918): Process ended prematurely: osmo-stp_10.42.42.5(pid=28918) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28918)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:56:45.425354 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:56:45.452058 run osmo-hlr_10.42.42.2(pid=28915): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28915)] 13:56:45.499680 run osmo-hlr_10.42.42.2(pid=28915): stdout: | (launched: 2022-12-13_13:56:42.620746) 13:56:45.548858 run osmo-hlr_10.42.42.2(pid=28915): stderr: | 20221213135642797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135642797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135642797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135642797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135642797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135642797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135642809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135642818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135642818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135642819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:45.617901 run osmo-msc_10.42.42.6(pid=28921): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28921)] 13:56:45.665315 run osmo-msc_10.42.42.6(pid=28921): stdout: | (launched: 2022-12-13_13:56:44.541910) 13:56:45.714267 run osmo-msc_10.42.42.6(pid=28921): stderr: | 20221213135644812 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135644812 DLGLOBAL DEBUG validating counter group 0x7fdff1ffdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135644812 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135644812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135644812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135644812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135644814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135644814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135644815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135644815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:45.763620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28914): Terminating (SIGTERM) 13:56:45.803279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28917): Terminating (SIGTERM) 13:56:45.862662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28920): Terminating (SIGTERM) 13:56:45.920468 --- ParallelTerminationStrategy: PID 28914 died... 13:56:45.939911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28914): Terminated: ok {rc=0} 13:56:45.984601 --- ParallelTerminationStrategy: PID 28917 died... 13:56:46.004095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28917): Terminated: ok {rc=0} 13:56:46.070983 --- ParallelTerminationStrategy: PID 28920 died... 13:56:46.095133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28920): Terminated: ok {rc=0} 13:56:46.188349 bus /sierra_3: Setting Powered False 13:56:47.288385 bus /sierra_3: Setting Powered False 13:56:48.402566 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:56:49.654785 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:49.660766 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:56:49.689400 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:56:49.715740 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:56:49.766408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:56:49.795264 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:56:49.821603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:56:50.372677 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:56:50.422043 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:50.433547 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:56:50.499226 tst mo_mt_call.py: using LAC 34409 13:56:50.618903 tst mo_mt_call.py: using RAC 239 13:56:50.739966 tst mo_mt_call.py: using CellId 34409 13:56:50.869940 tst mo_mt_call.py: using BVCI 34410 13:56:50.988857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:51.000703 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:51.012293 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:51.023857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:51.035755 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:56:51.047477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:56:51.164477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:56:51.285594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:51.792685 run create_hlr_db(pid=28926): Launched 13:56:51.916769 bus /sierra_2: Setting Powered False 13:56:52.981370 run create_hlr_db(pid=28926): Terminated: ok {rc=0} 13:56:53.417468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28928): Launched 13:56:53.724278 run osmo-hlr_10.42.42.2(pid=28929): Launched 13:56:53.839343 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:54.362914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28931): Launched 13:56:54.670442 run osmo-stp_10.42.42.5(pid=28932): Launched 13:56:54.787524 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:55.338482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28934): Launched 13:56:55.646218 run osmo-msc_10.42.42.6(pid=28935): Launched 13:56:55.818089 run osmo-stp_10.42.42.5(pid=28932): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28932)] 13:56:55.946784 run osmo-stp_10.42.42.5(pid=28932): stdout: | (launched: 2022-12-13_13:56:54.613121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:56.075712 run osmo-stp_10.42.42.5(pid=28932): stderr: | 20221213135654783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135654783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135654783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135654784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135654784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135654784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135654784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:56.203056 run osmo-stp_10.42.42.5(pid=28932): stdout: | (launched: 2022-12-13_13:56:54.613121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:56.323900 run osmo-stp_10.42.42.5(pid=28932): stderr: | 20221213135654783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135654783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135654783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135654784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135654784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135654784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135654784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:56.469150 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28932): Process ended prematurely: osmo-stp_10.42.42.5(pid=28932) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28932)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:56:56.478206 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:56:56.505066 run osmo-hlr_10.42.42.2(pid=28929): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28929)] 13:56:56.552693 run osmo-hlr_10.42.42.2(pid=28929): stdout: | (launched: 2022-12-13_13:56:53.666905) 13:56:56.601843 run osmo-hlr_10.42.42.2(pid=28929): stderr: | 20221213135653844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135653844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135653844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135653844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135653844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135653844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135653856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135653865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135653865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135653865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:56.670365 run osmo-msc_10.42.42.6(pid=28935): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28935)] 13:56:56.717706 run osmo-msc_10.42.42.6(pid=28935): stdout: | (launched: 2022-12-13_13:56:55.588699) 13:56:56.766694 run osmo-msc_10.42.42.6(pid=28935): stderr: | 20221213135655860 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135655860 DLGLOBAL DEBUG validating counter group 0x7ff738550c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135655860 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135655860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135655860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135655861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135655863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135655863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135655863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135655863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:56.816148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28928): Terminating (SIGTERM) 13:56:56.855513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28931): Terminating (SIGTERM) 13:56:56.894942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28934): Terminating (SIGTERM) 13:56:56.934668 --- ParallelTerminationStrategy: PID 28928 died... 13:56:56.953706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28928): Terminated: ok {rc=0} 13:56:56.997138 --- ParallelTerminationStrategy: PID 28931 died... 13:56:57.015724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28931): Terminated: ok {rc=0} 13:56:57.058916 --- ParallelTerminationStrategy: PID 28934 died... 13:56:57.077428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28934): Terminated: ok {rc=0} 13:56:57.161553 bus /sierra_3: Setting Powered False 13:56:58.259579 bus /sierra_3: Setting Powered False 13:56:59.371269 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:57:00.519247 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:00.531628 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:57:00.601208 tst mo_mt_call_osmux.py: using LAC 34410 13:57:00.727911 tst mo_mt_call_osmux.py: using RAC 240 13:57:00.854199 tst mo_mt_call_osmux.py: using CellId 34410 13:57:00.992833 tst mo_mt_call_osmux.py: using BVCI 34411 13:57:01.118404 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:01.131417 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:01.143841 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:01.157653 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:01.170630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:57:01.183700 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:57:01.311868 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:57:01.429745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:01.981870 run create_hlr_db(pid=28937): Launched 13:57:02.142752 bus /sierra_2: Setting Powered False 13:57:03.207763 run create_hlr_db(pid=28937): Terminated: ok {rc=0} 13:57:03.646195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Launched 13:57:03.955654 run osmo-hlr_10.42.42.2(pid=28940): Launched 13:57:04.071170 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:04.611275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Launched 13:57:04.916785 run osmo-stp_10.42.42.5(pid=28943): Launched 13:57:05.031784 run osmo-msc_10.42.42.6: Starting osmo-msc 13:57:05.578829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28945): Launched 13:57:05.885338 run osmo-msc_10.42.42.6(pid=28946): Launched 13:57:06.054713 run osmo-stp_10.42.42.5(pid=28943): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] 13:57:06.182401 run osmo-stp_10.42.42.5(pid=28943): stdout: | (launched: 2022-12-13_13:57:04.859838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:06.310882 run osmo-stp_10.42.42.5(pid=28943): stderr: | 20221213135705029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135705029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135705029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135705030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135705030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135705030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135705030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:06.437431 run osmo-stp_10.42.42.5(pid=28943): stdout: | (launched: 2022-12-13_13:57:04.859838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:06.558485 run osmo-stp_10.42.42.5(pid=28943): stderr: | 20221213135705029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135705029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135705029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135705030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135705030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135705030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135705030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:06.702579 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28943): Process ended prematurely: osmo-stp_10.42.42.5(pid=28943) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:57:06.711692 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:57:06.738531 run osmo-hlr_10.42.42.2(pid=28940): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28940)] 13:57:06.785685 run osmo-hlr_10.42.42.2(pid=28940): stdout: | (launched: 2022-12-13_13:57:03.898450) 13:57:06.834438 run osmo-hlr_10.42.42.2(pid=28940): stderr: | 20221213135704073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135704073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135704073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135704073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135704073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135704074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135704086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135704094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135704095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135704095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:06.902508 run osmo-msc_10.42.42.6(pid=28946): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28946)] 13:57:06.949494 run osmo-msc_10.42.42.6(pid=28946): stdout: | (launched: 2022-12-13_13:57:05.828091) 13:57:06.998244 run osmo-msc_10.42.42.6(pid=28946): stderr: | 20221213135706097 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135706098 DLGLOBAL DEBUG validating counter group 0x7ff793a07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135706098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135706098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135706098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135706098 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135706100 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135706100 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135706100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135706100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:57:07.047160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Terminating (SIGTERM) 13:57:07.086463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Terminating (SIGTERM) 13:57:07.125811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28945): Terminating (SIGTERM) 13:57:07.165758 --- ParallelTerminationStrategy: PID 28939 died... 13:57:07.185022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Terminated: ok {rc=0} 13:57:07.228744 --- ParallelTerminationStrategy: PID 28942 died... 13:57:07.247355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Terminated: ok {rc=0} 13:57:07.290893 --- ParallelTerminationStrategy: PID 28945 died... 13:57:07.309610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28945): Terminated: ok {rc=0} 13:57:07.394493 bus /sierra_3: Setting Powered False 13:57:08.492559 bus /sierra_3: Setting Powered False 13:57:09.605763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 13:57:10.846880 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:57:10.851485 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:57:10.880145 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:57:10.906538 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:57:10.990294 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:57:11.019240 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:57:11.045728 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:57:11.630099 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 13:57:11.635256 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:11.646340 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:57:11.690956 tst emergency_mo_mt_call.py: using LAC 34411 13:57:11.813974 tst emergency_mo_mt_call.py: using RAC 241 13:57:11.933639 tst emergency_mo_mt_call.py: using CellId 34411 13:57:12.055758 tst emergency_mo_mt_call.py: using BVCI 34412 13:57:12.164836 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:12.175786 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:12.186391 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:12.196874 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:12.207404 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:12.217926 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:12.339453 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:12.455792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:12.921696 run create_hlr_db(pid=28951): Launched 13:57:13.046818 bus /sierra_2: Setting Powered False 13:57:14.107652 run create_hlr_db(pid=28951): Terminated: ok {rc=0} 13:57:14.548543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28953): Launched 13:57:14.873658 run osmo-hlr_10.42.42.2(pid=28954): Launched 13:57:14.998714 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:15.554854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28956): Launched 13:57:15.882679 run osmo-stp_10.42.42.5(pid=28957): Launched 13:57:16.102596 tst emergency_mo_mt_call.py: using MSISDN 8187 13:57:16.402205 run osmo-msc_10.42.42.6: Starting osmo-msc 13:57:16.980204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28959): Launched 13:57:17.301176 run osmo-msc_10.42.42.6(pid=28960): Launched 13:57:17.578337 run osmo-stp_10.42.42.5(pid=28957): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28957)] 13:57:17.705068 run osmo-stp_10.42.42.5(pid=28957): stdout: | (launched: 2022-12-13_13:57:15.817961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:17.831309 run osmo-stp_10.42.42.5(pid=28957): stderr: | 20221213135716117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135716118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135716118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135716119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135716119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135716119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135716119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:17.955957 run osmo-stp_10.42.42.5(pid=28957): stdout: | (launched: 2022-12-13_13:57:15.817961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:18.073981 run osmo-stp_10.42.42.5(pid=28957): stderr: | 20221213135716117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135716118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135716118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135716119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135716119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135716119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135716119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:18.215660 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28957): Process ended prematurely: osmo-stp_10.42.42.5(pid=28957) [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28957)] [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 13:57:18.224207 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 13:57:18.250484 run osmo-hlr_10.42.42.2(pid=28954): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28954)] 13:57:18.298585 run osmo-hlr_10.42.42.2(pid=28954): stdout: | (launched: 2022-12-13_13:57:14.813918) 13:57:18.347873 run osmo-hlr_10.42.42.2(pid=28954): stderr: | 20221213135715009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135715009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135715009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135715009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135715009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135715009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135715021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135715031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135715031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135715031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:18.416289 run osmo-msc_10.42.42.6(pid=28960): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28960)] 13:57:18.463696 run osmo-msc_10.42.42.6(pid=28960): stdout: | (launched: 2022-12-13_13:57:17.244867) 13:57:18.512543 run osmo-msc_10.42.42.6(pid=28960): stderr: | 20221213135717620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135717620 DLGLOBAL DEBUG validating counter group 0x7f997df28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135717620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135717620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135717620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135717620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135717622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135717623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135717623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135717623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:57:18.561890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28953): Terminating (SIGTERM) 13:57:18.601105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28956): Terminating (SIGTERM) 13:57:18.640581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28959): Terminating (SIGTERM) 13:57:18.680581 --- ParallelTerminationStrategy: PID 28953 died... 13:57:18.699916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28953): Terminated: ok {rc=0} 13:57:18.743878 --- ParallelTerminationStrategy: PID 28956 died... 13:57:18.762747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28956): Terminated: ok {rc=0} 13:57:18.806536 --- ParallelTerminationStrategy: PID 28959 died... 13:57:18.825318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28959): Terminated: ok {rc=0} 13:57:18.910922 bus /sierra_3: Setting Powered False 13:57:20.009042 bus /sierra_3: Setting Powered False 13:57:21.120143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 13:57:22.203611 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.215124 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:57:22.260403 tst emergency_preemptive_call.py: using LAC 34412 13:57:22.376144 tst emergency_preemptive_call.py: using RAC 242 13:57:22.496069 tst emergency_preemptive_call.py: using CellId 34412 13:57:22.612020 tst emergency_preemptive_call.py: using BVCI 34413 13:57:22.719925 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.731000 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.741729 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.752343 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.763699 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:57:22.774642 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:22.888507 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:23.002673 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:23.123069 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:23.238948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:23.703850 run create_hlr_db(pid=28962): Launched 13:57:23.826936 bus /sierra_2: Setting Powered False 13:57:24.887059 run create_hlr_db(pid=28962): Terminated: ok {rc=0} 13:57:25.327673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Launched 13:57:25.649391 run osmo-hlr_10.42.42.2(pid=28965): Launched 13:57:25.774134 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:26.326562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Launched 13:57:26.648609 run osmo-stp_10.42.42.5(pid=28968): Launched 13:57:26.782516 tst emergency_preemptive_call.py: using MSISDN 8188 13:57:26.947583 run osmo-msc_10.42.42.6: Starting osmo-msc 13:57:27.522730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28970): Launched 13:57:27.844593 run osmo-msc_10.42.42.6(pid=28971): Launched 13:57:28.024488 run osmo-stp_10.42.42.5(pid=28968): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] 13:57:28.159822 run osmo-stp_10.42.42.5(pid=28968): stdout: | (launched: 2022-12-13_13:57:26.589195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:28.296130 run osmo-stp_10.42.42.5(pid=28968): stderr: | 20221213135726781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135726781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135726781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135726782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135726782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135726782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135726782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:28.431198 run osmo-stp_10.42.42.5(pid=28968): stdout: | (launched: 2022-12-13_13:57:26.589195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:28.558381 run osmo-stp_10.42.42.5(pid=28968): stderr: | 20221213135726781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135726781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135726781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135726782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135726782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135726782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135726782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:28.710542 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28968): Process ended prematurely: osmo-stp_10.42.42.5(pid=28968) [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 13:57:28.719751 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 13:57:28.747644 run osmo-hlr_10.42.42.2(pid=28965): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28965)] 13:57:28.798684 run osmo-hlr_10.42.42.2(pid=28965): stdout: | (launched: 2022-12-13_13:57:25.590114) 13:57:28.850849 run osmo-hlr_10.42.42.2(pid=28965): stderr: | 20221213135725785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135725785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135725785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135725786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135725786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135725786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135725799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135725809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135725809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135725809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:28.923099 run osmo-msc_10.42.42.6(pid=28971): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28971)] 13:57:28.972575 run osmo-msc_10.42.42.6(pid=28971): stdout: | (launched: 2022-12-13_13:57:27.785152) 13:57:29.024117 run osmo-msc_10.42.42.6(pid=28971): stderr: | 20221213135728103 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213135728103 DLGLOBAL DEBUG validating counter group 0x7f838aa75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213135728103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213135728103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213135728103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213135728103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213135728105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213135728106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213135728106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213135728106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:57:29.076257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Terminating (SIGTERM) 13:57:29.117984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Terminating (SIGTERM) 13:57:29.159960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28970): Terminating (SIGTERM) 13:57:29.202332 --- ParallelTerminationStrategy: PID 28964 died... 13:57:29.223043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Terminated: ok {rc=0} 13:57:29.269477 --- ParallelTerminationStrategy: PID 28967 died... 13:57:29.289510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Terminated: ok {rc=0} 13:57:29.335674 --- ParallelTerminationStrategy: PID 28970 died... 13:57:29.355643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28970): Terminated: ok {rc=0} 13:57:29.443282 bus /sierra_9: Setting Powered False 13:57:30.541241 bus /sierra_9: Setting Powered False 13:57:31.669319 bus /sierra_8: Setting Powered False 13:57:32.766340 bus /sierra_8: Setting Powered False 13:57:33.878724 bus /sierra_3: Setting Powered False 13:57:34.976385 bus /sierra_3: Setting Powered False 13:57:36.093143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 13:57:37.361620 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:57:37.365951 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:57:37.394480 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 13:57:37.432920 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:57:37.518027 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:57:37.546957 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 13:57:37.585207 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:57:38.178975 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 13:57:38.228424 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.239194 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:57:38.284064 tst cs_paging_gprs_active.py: using LAC 34413 13:57:38.405090 tst cs_paging_gprs_active.py: using RAC 243 13:57:38.524662 tst cs_paging_gprs_active.py: using CellId 34413 13:57:38.655315 tst cs_paging_gprs_active.py: using BVCI 34414 13:57:38.776187 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.787537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.798972 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.810295 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.821908 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.833290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.844717 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.856069 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:38.867545 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:38.987063 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:39.107196 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:57:39.317578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:39.624365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Launched 13:57:39.891650 run iperf3-srv_10.42.42.10(pid=28977): Launched 13:57:40.007489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:57:40.211400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:40.518717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28978): Launched 13:57:40.786794 run iperf3-srv_10.42.42.10(pid=28979): Launched 13:57:40.903447 tst cs_paging_gprs_active.py:38: start network... 13:57:41.107197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:41.580647 run create_hlr_db(pid=28980): Launched 13:57:41.707208 bus /sierra_2: Setting Powered False 13:57:42.767852 run create_hlr_db(pid=28980): Terminated: ok {rc=0} 13:57:43.214920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28982): Launched 13:57:43.544030 run osmo-hlr_10.42.42.2(pid=28983): Launched 13:57:43.669703 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:44.232701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28985): Launched 13:57:44.563437 run osmo-stp_10.42.42.5(pid=28986): Launched 13:57:44.689456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:45.255538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28988): Launched 13:57:45.379977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:45.640401 run patchelf(pid=28989): Launched 13:57:45.812608 run osmo-stp_10.42.42.5(pid=28986): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28986)] 13:57:45.953616 run osmo-stp_10.42.42.5(pid=28986): stdout: | (launched: 2022-12-13_13:57:44.502657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:46.091094 run osmo-stp_10.42.42.5(pid=28986): stderr: | 20221213135744692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135744693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135744693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135744693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135744694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135744694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135744694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:46.224872 run osmo-stp_10.42.42.5(pid=28986): stdout: | (launched: 2022-12-13_13:57:44.502657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:46.352246 run osmo-stp_10.42.42.5(pid=28986): stderr: | 20221213135744692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135744693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135744693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135744693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135744694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135744694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135744694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:46.503210 run patchelf(pid=28989): Terminating (SIGINT) 13:57:46.678325 run patchelf(pid=28989): Terminated: ok {rc=0} 13:57:46.804820 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28986): Process ended prematurely: osmo-stp_10.42.42.5(pid=28986) [trial-2390↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28986)] [trial-2390↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 13:57:46.815655 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:57:46.844232 run osmo-hlr_10.42.42.2(pid=28983): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28983)] 13:57:46.893986 run osmo-hlr_10.42.42.2(pid=28983): stdout: | (launched: 2022-12-13_13:57:43.483512) 13:57:46.944563 run osmo-hlr_10.42.42.2(pid=28983): stderr: | 20221213135743680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135743680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135743680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135743680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135743680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135743680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135743693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135743701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135743702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135743702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:46.995694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminating (SIGTERM) 13:57:47.036423 run iperf3-srv_10.42.42.10(pid=28977): Terminating (SIGTERM) 13:57:47.077026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28978): Terminating (SIGTERM) 13:57:47.117698 run iperf3-srv_10.42.42.10(pid=28979): Terminating (SIGTERM) 13:57:47.159984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28982): Terminating (SIGTERM) 13:57:47.201807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28985): Terminating (SIGTERM) 13:57:47.244127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28988): Terminating (SIGTERM) 13:57:47.285815 --- ParallelTerminationStrategy: PID 28976 died... 13:57:47.306814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminated: ok {rc=0} 13:57:47.350999 --- ParallelTerminationStrategy: PID 28977 died... 13:57:47.369685 run iperf3-srv_10.42.42.10(pid=28977): Terminated {rc=256} 13:57:47.413414 --- ParallelTerminationStrategy: PID 28978 died... 13:57:47.432125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28978): Terminated: ok {rc=0} 13:57:47.475990 --- ParallelTerminationStrategy: PID 28979 died... 13:57:47.494660 run iperf3-srv_10.42.42.10(pid=28979): Terminated {rc=256} 13:57:47.538368 --- ParallelTerminationStrategy: PID 28982 died... 13:57:47.557508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28982): Terminated: ok {rc=0} 13:57:47.601358 --- ParallelTerminationStrategy: PID 28985 died... 13:57:47.619906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28985): Terminated: ok {rc=0} 13:57:47.663817 --- ParallelTerminationStrategy: PID 28988 died... 13:57:47.682488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28988): Terminated: ok {rc=0} 13:57:47.768412 bus /gobi_0: Setting Powered False 13:57:48.867502 bus /gobi_0: Setting Powered False 13:57:49.982875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 13:57:51.129993 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.141598 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:57:51.188940 tst iperf3.py: using LAC 34414 13:57:51.311086 tst iperf3.py: using RAC 244 13:57:51.432801 tst iperf3.py: using CellId 34414 13:57:51.554604 tst iperf3.py: using BVCI 34415 13:57:51.666776 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.677894 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.688616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.699331 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.709778 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.720313 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.731694 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.742383 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:57:51.753205 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:57:51.872863 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:57:52.093593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:52.423057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Launched 13:57:52.709422 run iperf3-srv_10.42.42.10(pid=28991): Launched 13:57:52.835703 tst iperf3.py:8: start network... 13:57:53.058032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:53.567876 run create_hlr_db(pid=28992): Launched 13:57:53.694878 bus /gobi_6: Setting Powered False 13:57:54.758940 run create_hlr_db(pid=28992): Terminated: ok {rc=0} 13:57:55.195900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Launched 13:57:55.501973 run osmo-hlr_10.42.42.2(pid=28995): Launched 13:57:55.619838 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:56.144316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Launched 13:57:56.449465 run osmo-stp_10.42.42.5(pid=28998): Launched 13:57:56.566434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:57.094094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Launched 13:57:57.211374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:57.468816 run patchelf(pid=29001): Launched 13:57:57.638807 run osmo-stp_10.42.42.5(pid=28998): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] 13:57:57.767260 run osmo-stp_10.42.42.5(pid=28998): stdout: | (launched: 2022-12-13_13:57:56.392353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:57.897310 run osmo-stp_10.42.42.5(pid=28998): stderr: | 20221213135756560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135756560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135756561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135756561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135756562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135756562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135756562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:58.028163 run osmo-stp_10.42.42.5(pid=28998): stdout: | (launched: 2022-12-13_13:57:56.392353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:58.152631 run osmo-stp_10.42.42.5(pid=28998): stderr: | 20221213135756560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135756560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135756561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135756561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135756562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135756562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135756562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:58.300112 run patchelf(pid=29001): Terminating (SIGINT) 13:57:58.471559 run patchelf(pid=29001): Terminated: ok {rc=0} 13:57:58.594817 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28998): Process ended prematurely: osmo-stp_10.42.42.5(pid=28998) [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 13:57:58.604246 tst iperf3.py:8: Test FAILED (7.5 sec) 13:57:58.631361 run osmo-hlr_10.42.42.2(pid=28995): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28995)] 13:57:58.678491 run osmo-hlr_10.42.42.2(pid=28995): stdout: | (launched: 2022-12-13_13:57:55.444684) 13:57:58.727650 run osmo-hlr_10.42.42.2(pid=28995): stderr: | 20221213135755620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135755620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135755620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135755620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135755620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135755620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135755632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135755640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135755641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135755641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:58.776855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Terminating (SIGTERM) 13:57:58.816501 run iperf3-srv_10.42.42.10(pid=28991): Terminating (SIGTERM) 13:57:58.855798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Terminating (SIGTERM) 13:57:58.895178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Terminating (SIGTERM) 13:57:58.934488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Terminating (SIGTERM) 13:57:58.974675 --- ParallelTerminationStrategy: PID 28990 died... 13:57:58.993514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Terminated: ok {rc=0} 13:57:59.037629 --- ParallelTerminationStrategy: PID 28991 died... 13:57:59.056364 run iperf3-srv_10.42.42.10(pid=28991): Terminated {rc=256} 13:57:59.100061 --- ParallelTerminationStrategy: PID 28994 died... 13:57:59.118760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Terminated: ok {rc=0} 13:57:59.162651 --- ParallelTerminationStrategy: PID 28997 died... 13:57:59.181393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Terminated: ok {rc=0} 13:57:59.225279 --- ParallelTerminationStrategy: PID 29000 died... 13:57:59.243871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Terminated: ok {rc=0} 13:57:59.329024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 13:58:00.476141 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:00.487650 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:58:00.533066 tst iperf3m4.py: using LAC 34415 13:58:00.655540 tst iperf3m4.py: using RAC 245 13:58:00.776448 tst iperf3m4.py: using CellId 34415 13:58:00.922466 tst iperf3m4.py: using BVCI 34416 13:58:01.071836 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.088138 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.103996 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.121109 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.137779 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.155531 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.172626 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.189253 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:01.205236 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:01.369978 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:01.499747 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:01.646464 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:01.775679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:02.003978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:02.342188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29002): Launched 13:58:02.629565 run iperf3-srv_10.42.42.10(pid=29003): Launched 13:58:02.753172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:58:02.975190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:03.306878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29004): Launched 13:58:03.594093 run iperf3-srv_10.42.42.10(pid=29005): Launched 13:58:03.719517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:58:03.940798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:04.269912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29006): Launched 13:58:04.555399 run iperf3-srv_10.42.42.10(pid=29007): Launched 13:58:04.679771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:58:04.900663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:05.229371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29008): Launched 13:58:05.515890 run iperf3-srv_10.42.42.10(pid=29009): Launched 13:58:05.640753 tst iperf3m4.py:8: start network... 13:58:05.861220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:06.369353 run create_hlr_db(pid=29010): Launched 13:58:06.495869 bus /gobi_6: Setting Powered False 13:58:07.559750 run create_hlr_db(pid=29010): Terminated: ok {rc=0} 13:58:07.996636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29012): Launched 13:58:08.304205 run osmo-hlr_10.42.42.2(pid=29013): Launched 13:58:08.423824 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:09.082813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29015): Launched 13:58:09.382032 run osmo-stp_10.42.42.5(pid=29016): Launched 13:58:09.495608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:10.011491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29018): Launched 13:58:10.125483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:10.379177 run patchelf(pid=29019): Launched 13:58:10.544856 run osmo-stp_10.42.42.5(pid=29016): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29016)] 13:58:10.671188 run osmo-stp_10.42.42.5(pid=29016): stdout: | (launched: 2022-12-13_13:58:09.325989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:10.799186 run osmo-stp_10.42.42.5(pid=29016): stderr: | 20221213135809492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135809492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135809493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135809493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135809493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135809494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135809494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:10.927010 run osmo-stp_10.42.42.5(pid=29016): stdout: | (launched: 2022-12-13_13:58:09.325989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:11.049269 run osmo-stp_10.42.42.5(pid=29016): stderr: | 20221213135809492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135809492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135809493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135809493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135809493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135809494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135809494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:11.194591 run patchelf(pid=29019): Terminating (SIGINT) 13:58:11.363100 run patchelf(pid=29019): Terminated: ok {rc=0} 13:58:11.484261 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29016): Process ended prematurely: osmo-stp_10.42.42.5(pid=29016) [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29016)] [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 13:58:11.493902 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:58:11.520680 run osmo-hlr_10.42.42.2(pid=29013): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29013)] 13:58:11.567678 run osmo-hlr_10.42.42.2(pid=29013): stdout: | (launched: 2022-12-13_13:58:08.246881) 13:58:11.616195 run osmo-hlr_10.42.42.2(pid=29013): stderr: | 20221213135808421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135808421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135808421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135808421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135808421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135808421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135808433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135808441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135808442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135808442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:11.664839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29002): Terminating (SIGTERM) 13:58:11.704159 run iperf3-srv_10.42.42.10(pid=29003): Terminating (SIGTERM) 13:58:11.743023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29004): Terminating (SIGTERM) 13:58:11.782061 run iperf3-srv_10.42.42.10(pid=29005): Terminating (SIGTERM) 13:58:11.821218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29006): Terminating (SIGTERM) 13:58:11.860179 run iperf3-srv_10.42.42.10(pid=29007): Terminating (SIGTERM) 13:58:11.899394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29008): Terminating (SIGTERM) 13:58:11.938421 run iperf3-srv_10.42.42.10(pid=29009): Terminating (SIGTERM) 13:58:11.977419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29012): Terminating (SIGTERM) 13:58:12.016772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29015): Terminating (SIGTERM) 13:58:12.055726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29018): Terminating (SIGTERM) 13:58:12.094957 --- ParallelTerminationStrategy: PID 29002 died... 13:58:12.114185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29002): Terminated: ok {rc=0} 13:58:12.157577 --- ParallelTerminationStrategy: PID 29003 died... 13:58:12.175859 run iperf3-srv_10.42.42.10(pid=29003): Terminated {rc=256} 13:58:12.219306 --- ParallelTerminationStrategy: PID 29004 died... 13:58:12.237665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29004): Terminated: ok {rc=0} 13:58:12.280789 --- ParallelTerminationStrategy: PID 29005 died... 13:58:12.299781 run iperf3-srv_10.42.42.10(pid=29005): Terminated {rc=256} 13:58:12.343339 --- ParallelTerminationStrategy: PID 29006 died... 13:58:12.362445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29006): Terminated: ok {rc=0} 13:58:12.405867 --- ParallelTerminationStrategy: PID 29007 died... 13:58:12.424207 run iperf3-srv_10.42.42.10(pid=29007): Terminated {rc=256} 13:58:12.467837 --- ParallelTerminationStrategy: PID 29008 died... 13:58:12.486267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29008): Terminated: ok {rc=0} 13:58:12.529493 --- ParallelTerminationStrategy: PID 29009 died... 13:58:12.548198 run iperf3-srv_10.42.42.10(pid=29009): Terminated {rc=256} 13:58:12.591636 --- ParallelTerminationStrategy: PID 29012 died... 13:58:12.610130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29012): Terminated: ok {rc=0} 13:58:12.653274 --- ParallelTerminationStrategy: PID 29015 died... 13:58:12.671835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29015): Terminated: ok {rc=0} 13:58:12.715071 --- ParallelTerminationStrategy: PID 29018 died... 13:58:12.733536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29018): Terminated: ok {rc=0} 13:58:12.818361 bus /gobi_4: Setting Powered False 13:58:13.917319 bus /gobi_4: Setting Powered False 13:58:15.031180 bus /gobi_1: Setting Powered False 13:58:16.126263 bus /gobi_1: Setting Powered False 13:58:17.238641 bus /gobi_0: Setting Powered False 13:58:18.334528 bus /gobi_0: Setting Powered False 13:58:19.451932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 13:58:20.555000 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:20.567930 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:58:20.614842 tst ping.py: using LAC 34416 13:58:20.733117 tst ping.py: using RAC 246 13:58:20.849314 tst ping.py: using CellId 34416 13:58:20.974377 tst ping.py: using BVCI 34417 13:58:21.090715 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.102126 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.113445 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.124533 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.135998 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.147398 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.158964 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:21.170248 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:21.285938 tst ping.py:19: start network... 13:58:21.481195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:21.936284 run create_hlr_db(pid=29020): Launched 13:58:22.056068 bus /gobi_6: Setting Powered False 13:58:23.118538 run create_hlr_db(pid=29020): Terminated: ok {rc=0} 13:58:23.557911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29022): Launched 13:58:23.876443 run osmo-hlr_10.42.42.2(pid=29023): Launched 13:58:23.996152 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:24.543728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29025): Launched 13:58:24.860658 run osmo-stp_10.42.42.5(pid=29026): Launched 13:58:24.982408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:25.525612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29028): Launched 13:58:25.648131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:25.910152 run patchelf(pid=29029): Launched 13:58:26.073281 run osmo-stp_10.42.42.5(pid=29026): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29026)] 13:58:26.197479 run osmo-stp_10.42.42.5(pid=29026): stdout: | (launched: 2022-12-13_13:58:24.802230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:26.323693 run osmo-stp_10.42.42.5(pid=29026): stderr: | 20221213135824991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135824991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135824991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135824992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135824992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135824992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135824992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:26.449658 run osmo-stp_10.42.42.5(pid=29026): stdout: | (launched: 2022-12-13_13:58:24.802230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:26.569751 run osmo-stp_10.42.42.5(pid=29026): stderr: | 20221213135824991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135824991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135824991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135824992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135824992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135824992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135824992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:26.712440 run patchelf(pid=29029): Terminating (SIGINT) 13:58:26.877600 run patchelf(pid=29029): Terminated: ok {rc=0} 13:58:26.996708 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29026): Process ended prematurely: osmo-stp_10.42.42.5(pid=29026) [trial-2390↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29026)] [trial-2390↪gprs:trx-lms-limenet-micro↪ping.py:22] 13:58:27.005786 tst ping.py:22: Test FAILED (6.4 sec) 13:58:27.031848 run osmo-hlr_10.42.42.2(pid=29023): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29023)] 13:58:27.078627 run osmo-hlr_10.42.42.2(pid=29023): stdout: | (launched: 2022-12-13_13:58:23.817905) 13:58:27.127183 run osmo-hlr_10.42.42.2(pid=29023): stderr: | 20221213135824012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135824012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135824012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135824012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135824012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135824012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135824024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135824032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135824032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135824032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:27.175902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29022): Terminating (SIGTERM) 13:58:27.215848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29025): Terminating (SIGTERM) 13:58:27.255136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29028): Terminating (SIGTERM) 13:58:27.294650 --- ParallelTerminationStrategy: PID 29022 died... 13:58:27.313719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29022): Terminated: ok {rc=0} 13:58:27.357275 --- ParallelTerminationStrategy: PID 29025 died... 13:58:27.375587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29025): Terminated: ok {rc=0} 13:58:27.418971 --- ParallelTerminationStrategy: PID 29028 died... 13:58:27.437436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29028): Terminated: ok {rc=0} 13:58:27.521445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 13:58:28.609652 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:28.621973 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:58:28.668740 tst ping_idle_ping.py: using LAC 34417 13:58:28.793722 tst ping_idle_ping.py: using RAC 247 13:58:28.921276 tst ping_idle_ping.py: using CellId 34417 13:58:29.044439 tst ping_idle_ping.py: using BVCI 34418 13:58:29.159576 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.170907 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.182127 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.193256 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.204590 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.216125 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.227752 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:58:29.239382 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:58:29.356716 tst ping_idle_ping.py:24: start network... 13:58:29.569995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:30.060772 run create_hlr_db(pid=29030): Launched 13:58:30.181366 bus /gobi_6: Setting Powered False 13:58:31.245386 run create_hlr_db(pid=29030): Terminated: ok {rc=0} 13:58:31.701702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Launched 13:58:32.098266 run osmo-hlr_10.42.42.2(pid=29033): Launched 13:58:32.268448 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:32.789042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Launched 13:58:33.106220 run osmo-stp_10.42.42.5(pid=29036): Launched 13:58:33.225987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:33.772386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Launched 13:58:33.894608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:34.162185 run patchelf(pid=29039): Launched 13:58:34.339205 run osmo-stp_10.42.42.5(pid=29036): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] 13:58:34.473391 run osmo-stp_10.42.42.5(pid=29036): stdout: | (launched: 2022-12-13_13:58:33.047144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:34.609297 run osmo-stp_10.42.42.5(pid=29036): stderr: | 20221213135833236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135833237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135833237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135833237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135833238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135833238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135833238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:34.745155 run osmo-stp_10.42.42.5(pid=29036): stdout: | (launched: 2022-12-13_13:58:33.047144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:34.874876 run osmo-stp_10.42.42.5(pid=29036): stderr: | 20221213135833236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135833237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135833237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135833237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135833238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135833238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135833238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:35.028262 run patchelf(pid=29039): Terminating (SIGINT) 13:58:35.205915 run patchelf(pid=29039): Terminated: ok {rc=0} 13:58:35.334275 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29036): Process ended prematurely: osmo-stp_10.42.42.5(pid=29036) [trial-2390↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] [trial-2390↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 13:58:35.343854 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:58:35.371456 run osmo-hlr_10.42.42.2(pid=29033): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29033)] 13:58:35.421880 run osmo-hlr_10.42.42.2(pid=29033): stdout: | (launched: 2022-12-13_13:58:32.019457) 13:58:35.473663 run osmo-hlr_10.42.42.2(pid=29033): stderr: | 20221213135832288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135832288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135832289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135832289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135832289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135832289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135832301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135832309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135832309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135832309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:35.525993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Terminating (SIGTERM) 13:58:35.567771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Terminating (SIGTERM) 13:58:35.609821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Terminating (SIGTERM) 13:58:35.652227 --- ParallelTerminationStrategy: PID 29032 died... 13:58:35.672342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Terminated: ok {rc=0} 13:58:35.718446 --- ParallelTerminationStrategy: PID 29035 died... 13:58:35.738281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Terminated: ok {rc=0} 13:58:35.784176 --- ParallelTerminationStrategy: PID 29038 died... 13:58:35.804218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Terminated: ok {rc=0} 13:58:35.891838 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 13:58:37.191335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:58:37.197212 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:58:37.226801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:58:37.267103 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:58:37.355532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:58:37.385160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:58:37.425068 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:58:38.021944 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:58:38.074463 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.085883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:58:38.133243 tst cs_paging_gprs_active.py: using LAC 34418 13:58:38.252106 tst cs_paging_gprs_active.py: using RAC 248 13:58:38.379363 tst cs_paging_gprs_active.py: using CellId 34418 13:58:38.506496 tst cs_paging_gprs_active.py: using BVCI 34419 13:58:38.623496 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.635285 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.646768 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.658084 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.669621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.681282 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.692827 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.704361 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:38.716084 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:38.834303 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:38.951085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:58:39.152525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:39.455987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Launched 13:58:39.719035 run iperf3-srv_10.42.42.10(pid=29044): Launched 13:58:39.833587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:58:40.033971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:40.336714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Launched 13:58:40.599808 run iperf3-srv_10.42.42.10(pid=29046): Launched 13:58:40.712471 tst cs_paging_gprs_active.py:38: start network... 13:58:40.912853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:41.381137 run create_hlr_db(pid=29047): Launched 13:58:41.505210 bus /gobi_6: Setting Powered False 13:58:42.564904 run create_hlr_db(pid=29047): Terminated: ok {rc=0} 13:58:42.986336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Launched 13:58:43.287876 run osmo-hlr_10.42.42.2(pid=29050): Launched 13:58:43.403385 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:43.927957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Launched 13:58:44.230557 run osmo-stp_10.42.42.5(pid=29053): Launched 13:58:44.344766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:44.866770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Launched 13:58:44.981882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:45.237686 run patchelf(pid=29056): Launched 13:58:45.406929 run osmo-stp_10.42.42.5(pid=29053): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] 13:58:45.535075 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-13_13:58:44.173904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:45.664769 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221213135844340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135844340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135844341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135844341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135844342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135844342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135844342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:45.794225 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-13_13:58:44.173904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:45.926870 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221213135844340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135844340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135844341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135844341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135844342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135844342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135844342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:46.075540 run patchelf(pid=29056): Terminating (SIGINT) 13:58:46.249103 run patchelf(pid=29056): Terminated: ok {rc=0} 13:58:46.374850 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:58:46.385729 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 13:58:46.413772 run osmo-hlr_10.42.42.2(pid=29050): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29050)] 13:58:46.462042 run osmo-hlr_10.42.42.2(pid=29050): stdout: | (launched: 2022-12-13_13:58:43.231800) 13:58:46.511744 run osmo-hlr_10.42.42.2(pid=29050): stderr: | 20221213135843409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135843409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135843409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135843409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135843409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135843409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135843421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135843430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135843430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135843430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:46.561759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Terminating (SIGTERM) 13:58:46.602257 run iperf3-srv_10.42.42.10(pid=29044): Terminating (SIGTERM) 13:58:46.642580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminating (SIGTERM) 13:58:46.683334 run iperf3-srv_10.42.42.10(pid=29046): Terminating (SIGTERM) 13:58:46.726651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminating (SIGTERM) 13:58:46.767463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminating (SIGTERM) 13:58:46.808083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Terminating (SIGTERM) 13:58:46.850265 --- ParallelTerminationStrategy: PID 29043 died... 13:58:46.869698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Terminated: ok {rc=0} 13:58:46.914586 --- ParallelTerminationStrategy: PID 29044 died... 13:58:46.933891 run iperf3-srv_10.42.42.10(pid=29044): Terminated {rc=256} 13:58:46.978162 --- ParallelTerminationStrategy: PID 29045 died... 13:58:46.997298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminated: ok {rc=0} 13:58:47.041620 --- ParallelTerminationStrategy: PID 29046 died... 13:58:47.060627 run iperf3-srv_10.42.42.10(pid=29046): Terminated {rc=256} 13:58:47.104869 --- ParallelTerminationStrategy: PID 29049 died... 13:58:47.124042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminated: ok {rc=0} 13:58:47.168198 --- ParallelTerminationStrategy: PID 29052 died... 13:58:47.187235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminated: ok {rc=0} 13:58:47.231606 --- ParallelTerminationStrategy: PID 29055 died... 13:58:47.250739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Terminated: ok {rc=0} 13:58:47.335988 bus /gobi_0: Setting Powered False 13:58:48.436349 bus /gobi_0: Setting Powered False 13:58:49.550491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:58:50.694976 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:50.706604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:58:50.753486 tst iperf3.py: using LAC 34419 13:58:50.880671 tst iperf3.py: using RAC 249 13:58:50.999691 tst iperf3.py: using CellId 34419 13:58:51.118550 tst iperf3.py: using BVCI 34420 13:58:51.228796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.239862 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.250764 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.261522 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.272154 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.282934 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.293833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.304441 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:51.315347 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:51.431145 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:51.631195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:51.931753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Launched 13:58:52.192860 run iperf3-srv_10.42.42.10(pid=29058): Launched 13:58:52.305141 tst iperf3.py:8: start network... 13:58:52.504926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:52.970296 run create_hlr_db(pid=29059): Launched 13:58:53.097361 bus /gobi_6: Setting Powered False 13:58:54.157285 run create_hlr_db(pid=29059): Terminated: ok {rc=0} 13:58:54.597545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Launched 13:58:54.922685 run osmo-hlr_10.42.42.2(pid=29062): Launched 13:58:55.046755 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:55.604407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Launched 13:58:55.927107 run osmo-stp_10.42.42.5(pid=29065): Launched 13:58:56.050504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:56.602780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Launched 13:58:56.727129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:56.999336 run patchelf(pid=29068): Launched 13:58:57.178325 run osmo-stp_10.42.42.5(pid=29065): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] 13:58:57.313858 run osmo-stp_10.42.42.5(pid=29065): stdout: | (launched: 2022-12-13_13:58:55.867961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:57.450958 run osmo-stp_10.42.42.5(pid=29065): stderr: | 20221213135856057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135856057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135856058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135856058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135856059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135856059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135856059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:57.588385 run osmo-stp_10.42.42.5(pid=29065): stdout: | (launched: 2022-12-13_13:58:55.867961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:57.719679 run osmo-stp_10.42.42.5(pid=29065): stderr: | 20221213135856057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135856057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135856058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135856058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135856059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135856059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135856059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:57.875498 run patchelf(pid=29068): Terminating (SIGINT) 13:58:58.055801 run patchelf(pid=29068): Terminated: ok {rc=0} 13:58:58.185839 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29065): Process ended prematurely: osmo-stp_10.42.42.5(pid=29065) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 13:58:58.196261 tst iperf3.py:8: Test FAILED (7.5 sec) 13:58:58.224593 run osmo-hlr_10.42.42.2(pid=29062): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29062)] 13:58:58.275011 run osmo-hlr_10.42.42.2(pid=29062): stdout: | (launched: 2022-12-13_13:58:54.862782) 13:58:58.326364 run osmo-hlr_10.42.42.2(pid=29062): stderr: | 20221213135855059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135855059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135855059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135855059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135855059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135855059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135855072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135855080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135855080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135855080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:58.378498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Terminating (SIGTERM) 13:58:58.420479 run iperf3-srv_10.42.42.10(pid=29058): Terminating (SIGTERM) 13:58:58.462427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Terminating (SIGTERM) 13:58:58.504473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Terminating (SIGTERM) 13:58:58.546552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Terminating (SIGTERM) 13:58:58.589109 --- ParallelTerminationStrategy: PID 29057 died... 13:58:58.609463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Terminated: ok {rc=0} 13:58:58.655685 --- ParallelTerminationStrategy: PID 29058 died... 13:58:58.675615 run iperf3-srv_10.42.42.10(pid=29058): Terminated {rc=256} 13:58:58.721379 --- ParallelTerminationStrategy: PID 29061 died... 13:58:58.741300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Terminated: ok {rc=0} 13:58:58.787103 --- ParallelTerminationStrategy: PID 29064 died... 13:58:58.807146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Terminated: ok {rc=0} 13:58:58.853053 --- ParallelTerminationStrategy: PID 29067 died... 13:58:58.872837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Terminated: ok {rc=0} 13:58:58.960154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:59:00.107992 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.120216 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:59:00.167674 tst iperf3m4.py: using LAC 34420 13:59:00.298225 tst iperf3m4.py: using RAC 250 13:59:00.424134 tst iperf3m4.py: using CellId 34420 13:59:00.550158 tst iperf3m4.py: using BVCI 34421 13:59:00.667247 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.678887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.690265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.701678 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.713569 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.725413 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.737362 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.749076 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:00.761058 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:00.886972 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:01.013035 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:01.135253 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:01.282016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:59:01.508907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:01.838459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29070): Launched 13:59:02.133645 run iperf3-srv_10.42.42.10(pid=29071): Launched 13:59:02.270433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:59:02.487480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:02.811390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29072): Launched 13:59:03.091450 run iperf3-srv_10.42.42.10(pid=29073): Launched 13:59:03.213884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:59:03.430392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:03.753690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Launched 13:59:04.017639 run iperf3-srv_10.42.42.10(pid=29075): Launched 13:59:04.130821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:59:04.332375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:04.636521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Launched 13:59:04.897729 run iperf3-srv_10.42.42.10(pid=29077): Launched 13:59:05.010612 tst iperf3m4.py:8: start network... 13:59:05.211667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:05.681510 run create_hlr_db(pid=29078): Launched 13:59:05.805485 bus /gobi_6: Setting Powered False 13:59:06.865785 run create_hlr_db(pid=29078): Terminated: ok {rc=0} 13:59:07.285474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29080): Launched 13:59:07.589998 run osmo-hlr_10.42.42.2(pid=29081): Launched 13:59:07.704648 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:08.235754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29083): Launched 13:59:08.536815 run osmo-stp_10.42.42.5(pid=29084): Launched 13:59:08.649818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:09.168002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29086): Launched 13:59:09.284418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:09.539254 run patchelf(pid=29087): Launched 13:59:09.705837 run osmo-stp_10.42.42.5(pid=29084): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29084)] 13:59:09.833129 run osmo-stp_10.42.42.5(pid=29084): stdout: | (launched: 2022-12-13_13:59:08.480021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:09.962472 run osmo-stp_10.42.42.5(pid=29084): stderr: | 20221213135908651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135908651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135908651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135908652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135908652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135908652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135908652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:10.091445 run osmo-stp_10.42.42.5(pid=29084): stdout: | (launched: 2022-12-13_13:59:08.480021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:10.214519 run osmo-stp_10.42.42.5(pid=29084): stderr: | 20221213135908651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135908651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135908651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135908652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135908652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135908652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135908652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:10.360021 run patchelf(pid=29087): Terminating (SIGINT) 13:59:10.529623 run patchelf(pid=29087): Terminated: ok {rc=0} 13:59:10.651518 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29084): Process ended prematurely: osmo-stp_10.42.42.5(pid=29084) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29084)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 13:59:10.661240 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:59:10.688090 run osmo-hlr_10.42.42.2(pid=29081): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29081)] 13:59:10.734794 run osmo-hlr_10.42.42.2(pid=29081): stdout: | (launched: 2022-12-13_13:59:07.533041) 13:59:10.783228 run osmo-hlr_10.42.42.2(pid=29081): stderr: | 20221213135907708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135907708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135907708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135907708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135907708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135907708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135907720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135907729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135907729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135907730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:10.831859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29070): Terminating (SIGTERM) 13:59:10.871099 run iperf3-srv_10.42.42.10(pid=29071): Terminating (SIGTERM) 13:59:10.910098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29072): Terminating (SIGTERM) 13:59:10.949210 run iperf3-srv_10.42.42.10(pid=29073): Terminating (SIGTERM) 13:59:10.988028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Terminating (SIGTERM) 13:59:11.027090 run iperf3-srv_10.42.42.10(pid=29075): Terminating (SIGTERM) 13:59:11.065917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Terminating (SIGTERM) 13:59:11.104875 run iperf3-srv_10.42.42.10(pid=29077): Terminating (SIGTERM) 13:59:11.143727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29080): Terminating (SIGTERM) 13:59:11.182579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29083): Terminating (SIGTERM) 13:59:11.221427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29086): Terminating (SIGTERM) 13:59:11.260582 --- ParallelTerminationStrategy: PID 29070 died... 13:59:11.279301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29070): Terminated: ok {rc=0} 13:59:11.322251 --- ParallelTerminationStrategy: PID 29071 died... 13:59:11.340304 run iperf3-srv_10.42.42.10(pid=29071): Terminated {rc=256} 13:59:11.383147 --- ParallelTerminationStrategy: PID 29072 died... 13:59:11.401414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29072): Terminated: ok {rc=0} 13:59:11.444278 --- ParallelTerminationStrategy: PID 29073 died... 13:59:11.462506 run iperf3-srv_10.42.42.10(pid=29073): Terminated {rc=256} 13:59:11.505339 --- ParallelTerminationStrategy: PID 29074 died... 13:59:11.523436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Terminated: ok {rc=0} 13:59:11.566927 --- ParallelTerminationStrategy: PID 29075 died... 13:59:11.585213 run iperf3-srv_10.42.42.10(pid=29075): Terminated {rc=256} 13:59:11.627768 --- ParallelTerminationStrategy: PID 29076 died... 13:59:11.646139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Terminated: ok {rc=0} 13:59:11.689133 --- ParallelTerminationStrategy: PID 29077 died... 13:59:11.707285 run iperf3-srv_10.42.42.10(pid=29077): Terminated {rc=256} 13:59:11.750016 --- ParallelTerminationStrategy: PID 29080 died... 13:59:11.768287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29080): Terminated: ok {rc=0} 13:59:11.811240 --- ParallelTerminationStrategy: PID 29083 died... 13:59:11.829739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29083): Terminated: ok {rc=0} 13:59:11.873413 --- ParallelTerminationStrategy: PID 29086 died... 13:59:11.891860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29086): Terminated: ok {rc=0} 13:59:11.975733 bus /gobi_4: Setting Powered False 13:59:13.075265 bus /gobi_4: Setting Powered False 13:59:14.189680 bus /gobi_1: Setting Powered False 13:59:15.287269 bus /gobi_1: Setting Powered False 13:59:16.398044 bus /gobi_0: Setting Powered False 13:59:17.510616 bus /gobi_0: Setting Powered False 13:59:18.627155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 13:59:19.726203 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:19.737910 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:59:19.784634 tst ping.py: using LAC 34421 13:59:19.904740 tst ping.py: using RAC 251 13:59:20.019713 tst ping.py: using CellId 34421 13:59:20.144003 tst ping.py: using BVCI 34422 13:59:20.259088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.270635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.282243 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.293630 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.305329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.317268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.329298 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:20.340901 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:20.456340 tst ping.py:19: start network... 13:59:20.653803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:21.111799 run create_hlr_db(pid=29088): Launched 13:59:21.233477 bus /gobi_6: Setting Powered False 13:59:22.295958 run create_hlr_db(pid=29088): Terminated: ok {rc=0} 13:59:22.736098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29090): Launched 13:59:23.053392 run osmo-hlr_10.42.42.2(pid=29091): Launched 13:59:23.175557 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:23.723236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29093): Launched 13:59:24.038557 run osmo-stp_10.42.42.5(pid=29094): Launched 13:59:24.159629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:24.703829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29096): Launched 13:59:24.820816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:25.071425 run patchelf(pid=29097): Launched 13:59:25.235799 run osmo-stp_10.42.42.5(pid=29094): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29094)] 13:59:25.360753 run osmo-stp_10.42.42.5(pid=29094): stdout: | (launched: 2022-12-13_13:59:23.980152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:25.488086 run osmo-stp_10.42.42.5(pid=29094): stderr: | 20221213135924168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135924169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135924169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135924169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135924170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135924170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135924170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:25.615475 run osmo-stp_10.42.42.5(pid=29094): stdout: | (launched: 2022-12-13_13:59:23.980152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:25.737235 run osmo-stp_10.42.42.5(pid=29094): stderr: | 20221213135924168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135924169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135924169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135924169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135924170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135924170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135924170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:25.880340 run patchelf(pid=29097): Terminating (SIGINT) 13:59:26.046061 run patchelf(pid=29097): Terminated: ok {rc=0} 13:59:26.165948 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29094): Process ended prematurely: osmo-stp_10.42.42.5(pid=29094) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29094)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 13:59:26.174849 tst ping.py:22: Test FAILED (6.4 sec) 13:59:26.201307 run osmo-hlr_10.42.42.2(pid=29091): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29091)] 13:59:26.247655 run osmo-hlr_10.42.42.2(pid=29091): stdout: | (launched: 2022-12-13_13:59:22.995094) 13:59:26.295954 run osmo-hlr_10.42.42.2(pid=29091): stderr: | 20221213135923190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135923190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135923190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135923190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135923190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135923190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135923202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135923211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135923211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135923211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:26.344782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29090): Terminating (SIGTERM) 13:59:26.383830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29093): Terminating (SIGTERM) 13:59:26.422775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29096): Terminating (SIGTERM) 13:59:26.462400 --- ParallelTerminationStrategy: PID 29090 died... 13:59:26.481460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29090): Terminated: ok {rc=0} 13:59:26.524818 --- ParallelTerminationStrategy: PID 29093 died... 13:59:26.543722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29093): Terminated: ok {rc=0} 13:59:26.586876 --- ParallelTerminationStrategy: PID 29096 died... 13:59:26.605456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29096): Terminated: ok {rc=0} 13:59:26.686643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:59:27.771766 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:27.783786 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:59:27.832845 tst ping_idle_ping.py: using LAC 34422 13:59:27.951247 tst ping_idle_ping.py: using RAC 252 13:59:28.081504 tst ping_idle_ping.py: using CellId 34422 13:59:28.205608 tst ping_idle_ping.py: using BVCI 34423 13:59:28.321569 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.333266 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.344551 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.355940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.367875 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.379905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.392112 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:59:28.403949 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:59:28.520247 tst ping_idle_ping.py:24: start network... 13:59:28.717761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:29.179607 run create_hlr_db(pid=29099): Launched 13:59:29.301233 bus /gobi_6: Setting Powered False 13:59:30.360625 run create_hlr_db(pid=29099): Terminated: ok {rc=0} 13:59:30.794789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29101): Launched 13:59:31.142047 run osmo-hlr_10.42.42.2(pid=29102): Launched 13:59:31.377755 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:32.005715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29104): Launched 13:59:32.340171 run osmo-stp_10.42.42.5(pid=29105): Launched 13:59:32.454704 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:32.967912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29107): Launched 13:59:33.080315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:33.329869 run patchelf(pid=29108): Launched 13:59:33.494240 run osmo-stp_10.42.42.5(pid=29105): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29105)] 13:59:33.619128 run osmo-stp_10.42.42.5(pid=29105): stdout: | (launched: 2022-12-13_13:59:32.276221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:33.746759 run osmo-stp_10.42.42.5(pid=29105): stderr: | 20221213135932452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135932452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135932452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135932452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135932453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135932453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135932453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:33.873432 run osmo-stp_10.42.42.5(pid=29105): stdout: | (launched: 2022-12-13_13:59:32.276221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:33.994125 run osmo-stp_10.42.42.5(pid=29105): stderr: | 20221213135932452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135932452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135932452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135932452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135932453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135932453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135932453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:34.137176 run patchelf(pid=29108): Terminating (SIGINT) 13:59:34.302717 run patchelf(pid=29108): Terminated: ok {rc=0} 13:59:34.422180 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29105): Process ended prematurely: osmo-stp_10.42.42.5(pid=29105) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29105)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 13:59:34.431089 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:59:34.457939 run osmo-hlr_10.42.42.2(pid=29102): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29102)] 13:59:34.505094 run osmo-hlr_10.42.42.2(pid=29102): stdout: | (launched: 2022-12-13_13:59:31.083799) 13:59:34.553764 run osmo-hlr_10.42.42.2(pid=29102): stderr: | 20221213135931310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135931310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135931310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135931310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135931310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135931310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135931327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135931344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135931344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135931344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:34.602782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29101): Terminating (SIGTERM) 13:59:34.642145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29104): Terminating (SIGTERM) 13:59:34.681637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29107): Terminating (SIGTERM) 13:59:34.721299 --- ParallelTerminationStrategy: PID 29101 died... 13:59:34.740329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29101): Terminated: ok {rc=0} 13:59:34.784278 --- ParallelTerminationStrategy: PID 29104 died... 13:59:34.802722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29104): Terminated: ok {rc=0} 13:59:34.846131 --- ParallelTerminationStrategy: PID 29107 died... 13:59:34.864616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29107): Terminated: ok {rc=0} 13:59:34.947245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:59:36.253554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:36.260598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:59:36.290833 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:59:36.332749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:59:36.421708 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:59:36.451497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:59:36.491228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:59:37.090773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:59:37.143426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.154906 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:59:37.222082 tst cs_paging_gprs_active.py: using LAC 34423 13:59:37.349075 tst cs_paging_gprs_active.py: using RAC 253 13:59:37.475393 tst cs_paging_gprs_active.py: using CellId 34423 13:59:37.602461 tst cs_paging_gprs_active.py: using BVCI 34424 13:59:37.720134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.731705 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.743084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.754672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.766403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.778056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.789979 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.801851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:37.813881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:37.931943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:38.053418 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:59:38.271247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:38.595874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Launched 13:59:38.877391 run iperf3-srv_10.42.42.10(pid=29113): Launched 13:59:38.998970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:59:39.216770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:39.543850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Launched 13:59:39.826206 run iperf3-srv_10.42.42.10(pid=29115): Launched 13:59:39.948011 tst cs_paging_gprs_active.py:38: start network... 13:59:40.165950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:40.667367 run create_hlr_db(pid=29116): Launched 13:59:40.789609 bus /gobi_6: Setting Powered False 13:59:41.853851 run create_hlr_db(pid=29116): Terminated: ok {rc=0} 13:59:42.302965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29118): Launched 13:59:42.628388 run osmo-hlr_10.42.42.2(pid=29119): Launched 13:59:42.751983 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:43.306734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29121): Launched 13:59:43.633062 run osmo-stp_10.42.42.5(pid=29122): Launched 13:59:43.757497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:44.315237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29124): Launched 13:59:44.439100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:44.712193 run patchelf(pid=29125): Launched 13:59:44.893761 run osmo-stp_10.42.42.5(pid=29122): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29122)] 13:59:45.030982 run osmo-stp_10.42.42.5(pid=29122): stdout: | (launched: 2022-12-13_13:59:43.573318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:45.169747 run osmo-stp_10.42.42.5(pid=29122): stderr: | 20221213135943762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135943762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135943763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135943763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135943764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135943764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135943764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:45.308294 run osmo-stp_10.42.42.5(pid=29122): stdout: | (launched: 2022-12-13_13:59:43.573318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:45.441064 run osmo-stp_10.42.42.5(pid=29122): stderr: | 20221213135943762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135943762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135943763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135943763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135943764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135943764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135943764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:45.598257 run patchelf(pid=29125): Terminating (SIGINT) 13:59:45.779887 run patchelf(pid=29125): Terminated: ok {rc=0} 13:59:45.914154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29122): Process ended prematurely: osmo-stp_10.42.42.5(pid=29122) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29122)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:59:45.926056 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:59:45.955516 run osmo-hlr_10.42.42.2(pid=29119): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29119)] 13:59:46.009080 run osmo-hlr_10.42.42.2(pid=29119): stdout: | (launched: 2022-12-13_13:59:42.568136) 13:59:46.062459 run osmo-hlr_10.42.42.2(pid=29119): stderr: | 20221213135942765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135942765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135942765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135942765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135942765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135942765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135942778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135942789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135942789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135942789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:46.116767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Terminating (SIGTERM) 13:59:46.159474 run iperf3-srv_10.42.42.10(pid=29113): Terminating (SIGTERM) 13:59:46.204416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Terminating (SIGTERM) 13:59:46.248328 run iperf3-srv_10.42.42.10(pid=29115): Terminating (SIGTERM) 13:59:46.293235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29118): Terminating (SIGTERM) 13:59:46.337291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29121): Terminating (SIGTERM) 13:59:46.381138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29124): Terminating (SIGTERM) 13:59:46.425181 --- ParallelTerminationStrategy: PID 29112 died... 13:59:46.446881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Terminated: ok {rc=0} 13:59:46.494913 --- ParallelTerminationStrategy: PID 29113 died... 13:59:46.516168 run iperf3-srv_10.42.42.10(pid=29113): Terminated {rc=256} 13:59:46.563944 --- ParallelTerminationStrategy: PID 29114 died... 13:59:46.585457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Terminated: ok {rc=0} 13:59:46.633340 --- ParallelTerminationStrategy: PID 29115 died... 13:59:46.654657 run iperf3-srv_10.42.42.10(pid=29115): Terminated {rc=256} 13:59:46.702394 --- ParallelTerminationStrategy: PID 29118 died... 13:59:46.723847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29118): Terminated: ok {rc=0} 13:59:46.771534 --- ParallelTerminationStrategy: PID 29121 died... 13:59:46.792653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29121): Terminated: ok {rc=0} 13:59:46.840709 --- ParallelTerminationStrategy: PID 29124 died... 13:59:46.861797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29124): Terminated: ok {rc=0} 13:59:46.955027 bus /gobi_0: Setting Powered False 13:59:48.050772 bus /gobi_0: Setting Powered False 13:59:49.164140 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:59:50.308312 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.320252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:59:50.388879 tst iperf3.py: using LAC 34424 13:59:50.508819 tst iperf3.py: using RAC 254 13:59:50.626637 tst iperf3.py: using CellId 34424 13:59:50.748271 tst iperf3.py: using BVCI 34425 13:59:50.859289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.870373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.881444 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.892232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.903089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.913967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.924849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.935629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:50.946549 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:51.062297 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:59:51.263902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:51.571027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Launched 13:59:51.834287 run iperf3-srv_10.42.42.10(pid=29127): Launched 13:59:51.950231 tst iperf3.py:8: start network... 13:59:52.151295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:52.618469 run create_hlr_db(pid=29128): Launched 13:59:52.741821 bus /gobi_6: Setting Powered False 13:59:53.801895 run create_hlr_db(pid=29128): Terminated: ok {rc=0} 13:59:54.241599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Launched 13:59:54.565958 run osmo-hlr_10.42.42.2(pid=29131): Launched 13:59:54.688110 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:55.250914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Launched 13:59:55.573839 run osmo-stp_10.42.42.5(pid=29134): Launched 13:59:55.699399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:56.254060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Launched 13:59:56.378140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:56.651008 run patchelf(pid=29137): Launched 13:59:56.828922 run osmo-stp_10.42.42.5(pid=29134): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] 13:59:56.965394 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-13_13:59:55.514564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:57.103318 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221213135955703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135955703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135955704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135955704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135955705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135955705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135955705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:57.241489 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-13_13:59:55.514564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:57.373297 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221213135955703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213135955703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213135955704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213135955704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213135955705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213135955705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213135955705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:57.529690 run patchelf(pid=29137): Terminating (SIGINT) 13:59:57.711186 run patchelf(pid=29137): Terminated: ok {rc=0} 13:59:57.841874 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 13:59:57.852059 tst iperf3.py:8: Test FAILED (7.6 sec) 13:59:57.880402 run osmo-hlr_10.42.42.2(pid=29131): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29131)] 13:59:57.930877 run osmo-hlr_10.42.42.2(pid=29131): stdout: | (launched: 2022-12-13_13:59:54.506185) 13:59:57.982437 run osmo-hlr_10.42.42.2(pid=29131): stderr: | 20221213135954700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213135954700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213135954700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213135954700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213135954700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213135954700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213135954713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213135954721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213135954721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213135954721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:58.034623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminating (SIGTERM) 13:59:58.076236 run iperf3-srv_10.42.42.10(pid=29127): Terminating (SIGTERM) 13:59:58.119201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminating (SIGTERM) 13:59:58.161241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminating (SIGTERM) 13:59:58.202971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminating (SIGTERM) 13:59:58.245406 --- ParallelTerminationStrategy: PID 29126 died... 13:59:58.265664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminated: ok {rc=0} 13:59:58.311780 --- ParallelTerminationStrategy: PID 29127 died... 13:59:58.331543 run iperf3-srv_10.42.42.10(pid=29127): Terminated {rc=256} 13:59:58.377393 --- ParallelTerminationStrategy: PID 29130 died... 13:59:58.397203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminated: ok {rc=0} 13:59:58.443038 --- ParallelTerminationStrategy: PID 29133 died... 13:59:58.462849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminated: ok {rc=0} 13:59:58.508706 --- ParallelTerminationStrategy: PID 29136 died... 13:59:58.528639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminated: ok {rc=0} 13:59:58.616666 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:59:59.762115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:59.773677 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:59:59.839274 tst iperf3m4.py: using LAC 34425 13:59:59.957784 tst iperf3m4.py: using RAC 255 14:00:00.086306 tst iperf3m4.py: using CellId 34425 14:00:00.213670 tst iperf3m4.py: using BVCI 34426 14:00:00.323276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.334384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.345431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.356280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.367064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.377931 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.388731 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.399527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:00.410541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:00.531528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:00.651088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:00.770817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:00.903268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:00:01.119284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:01.440280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29142): Launched 14:00:01.761825 run iperf3-srv_10.42.42.10(pid=29143): Launched 14:00:01.896413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:00:02.102495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:02.408928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29144): Launched 14:00:02.671846 run iperf3-srv_10.42.42.10(pid=29145): Launched 14:00:02.785305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:00:02.985944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:03.288216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29146): Launched 14:00:03.550525 run iperf3-srv_10.42.42.10(pid=29147): Launched 14:00:03.663820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:00:03.864422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:04.166967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29148): Launched 14:00:04.428919 run iperf3-srv_10.42.42.10(pid=29149): Launched 14:00:04.541929 tst iperf3m4.py:8: start network... 14:00:04.742621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:05.207765 run create_hlr_db(pid=29150): Launched 14:00:05.332037 bus /gobi_6: Setting Powered False 14:00:06.392843 run create_hlr_db(pid=29150): Terminated: ok {rc=0} 14:00:06.831558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29152): Launched 14:00:07.154689 run osmo-hlr_10.42.42.2(pid=29153): Launched 14:00:07.276837 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:07.834465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29155): Launched 14:00:08.157877 run osmo-stp_10.42.42.5(pid=29156): Launched 14:00:08.275017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:00:08.797733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29158): Launched 14:00:08.912551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:00:09.167505 run patchelf(pid=29159): Launched 14:00:09.334465 run osmo-stp_10.42.42.5(pid=29156): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29156)] 14:00:09.461391 run osmo-stp_10.42.42.5(pid=29156): stdout: | (launched: 2022-12-13_14:00:08.098359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:09.590071 run osmo-stp_10.42.42.5(pid=29156): stderr: | 20221213140008268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140008268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140008268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140008269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140008269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140008269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140008269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:09.718572 run osmo-stp_10.42.42.5(pid=29156): stdout: | (launched: 2022-12-13_14:00:08.098359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:09.841379 run osmo-stp_10.42.42.5(pid=29156): stderr: | 20221213140008268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140008268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140008268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140008269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140008269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140008269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140008269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:09.986823 run patchelf(pid=29159): Terminating (SIGINT) 14:00:10.157403 run patchelf(pid=29159): Terminated: ok {rc=0} 14:00:10.279098 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29156): Process ended prematurely: osmo-stp_10.42.42.5(pid=29156) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29156)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:00:10.288541 tst iperf3m4.py:8: Test FAILED (10.6 sec) 14:00:10.315540 run osmo-hlr_10.42.42.2(pid=29153): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29153)] 14:00:10.362156 run osmo-hlr_10.42.42.2(pid=29153): stdout: | (launched: 2022-12-13_14:00:07.094886) 14:00:10.410443 run osmo-hlr_10.42.42.2(pid=29153): stderr: | 20221213140007288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140007288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140007288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140007288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140007288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140007288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140007302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140007310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140007310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140007310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:10.459206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29142): Terminating (SIGTERM) 14:00:10.498422 run iperf3-srv_10.42.42.10(pid=29143): Terminating (SIGTERM) 14:00:10.537530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29144): Terminating (SIGTERM) 14:00:10.576500 run iperf3-srv_10.42.42.10(pid=29145): Terminating (SIGTERM) 14:00:10.615453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29146): Terminating (SIGTERM) 14:00:10.654449 run iperf3-srv_10.42.42.10(pid=29147): Terminating (SIGTERM) 14:00:10.693278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29148): Terminating (SIGTERM) 14:00:10.732248 run iperf3-srv_10.42.42.10(pid=29149): Terminating (SIGTERM) 14:00:10.771229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29152): Terminating (SIGTERM) 14:00:10.810195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29155): Terminating (SIGTERM) 14:00:10.849392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29158): Terminating (SIGTERM) 14:00:10.888550 --- ParallelTerminationStrategy: PID 29142 died... 14:00:10.907162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29142): Terminated: ok {rc=0} 14:00:10.950497 --- ParallelTerminationStrategy: PID 29143 died... 14:00:10.968683 run iperf3-srv_10.42.42.10(pid=29143): Terminated {rc=256} 14:00:11.011790 --- ParallelTerminationStrategy: PID 29144 died... 14:00:11.030128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29144): Terminated: ok {rc=0} 14:00:11.073431 --- ParallelTerminationStrategy: PID 29145 died... 14:00:11.091631 run iperf3-srv_10.42.42.10(pid=29145): Terminated {rc=256} 14:00:11.134746 --- ParallelTerminationStrategy: PID 29146 died... 14:00:11.153074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29146): Terminated: ok {rc=0} 14:00:11.195919 --- ParallelTerminationStrategy: PID 29147 died... 14:00:11.214114 run iperf3-srv_10.42.42.10(pid=29147): Terminated {rc=256} 14:00:11.257008 --- ParallelTerminationStrategy: PID 29148 died... 14:00:11.275233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29148): Terminated: ok {rc=0} 14:00:11.318249 --- ParallelTerminationStrategy: PID 29149 died... 14:00:11.336437 run iperf3-srv_10.42.42.10(pid=29149): Terminated {rc=256} 14:00:11.379302 --- ParallelTerminationStrategy: PID 29152 died... 14:00:11.397578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29152): Terminated: ok {rc=0} 14:00:11.440482 --- ParallelTerminationStrategy: PID 29155 died... 14:00:11.458811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29155): Terminated: ok {rc=0} 14:00:11.501997 --- ParallelTerminationStrategy: PID 29158 died... 14:00:11.520331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29158): Terminated: ok {rc=0} 14:00:11.604825 bus /gobi_4: Setting Powered False 14:00:12.705280 bus /gobi_4: Setting Powered False 14:00:13.820913 bus /gobi_1: Setting Powered False 14:00:14.918287 bus /gobi_1: Setting Powered False 14:00:16.039254 bus /gobi_0: Setting Powered False 14:00:17.154310 bus /gobi_0: Setting Powered False 14:00:18.273982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:00:19.376288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.387879 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:00:19.453338 tst ping.py: using LAC 34426 14:00:19.569678 tst ping.py: using RAC 1 14:00:19.684698 tst ping.py: using CellId 34426 14:00:19.800839 tst ping.py: using BVCI 34427 14:00:19.907181 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.918315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.929119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.939941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.950735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.961594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.972444 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:19.983293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:20.102111 tst ping.py:19: start network... 14:00:20.315593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:20.804515 run create_hlr_db(pid=29160): Launched 14:00:20.925649 bus /gobi_6: Setting Powered False 14:00:21.988325 run create_hlr_db(pid=29160): Terminated: ok {rc=0} 14:00:22.415279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29162): Launched 14:00:22.711237 run osmo-hlr_10.42.42.2(pid=29163): Launched 14:00:22.822010 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:23.331056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29165): Launched 14:00:23.624853 run osmo-stp_10.42.42.5(pid=29166): Launched 14:00:23.735588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:00:24.249726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29168): Launched 14:00:24.370864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:00:24.638839 run patchelf(pid=29169): Launched 14:00:24.814884 run osmo-stp_10.42.42.5(pid=29166): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29166)] 14:00:24.949120 run osmo-stp_10.42.42.5(pid=29166): stdout: | (launched: 2022-12-13_14:00:23.569945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:25.084559 run osmo-stp_10.42.42.5(pid=29166): stderr: | 20221213140023737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140023737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140023737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140023738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140023738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140023738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140023738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:25.220450 run osmo-stp_10.42.42.5(pid=29166): stdout: | (launched: 2022-12-13_14:00:23.569945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:25.350354 run osmo-stp_10.42.42.5(pid=29166): stderr: | 20221213140023737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140023737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140023737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140023738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140023738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140023738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140023738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:25.503942 run patchelf(pid=29169): Terminating (SIGINT) 14:00:25.681507 run patchelf(pid=29169): Terminated: ok {rc=0} 14:00:25.809313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29166): Process ended prematurely: osmo-stp_10.42.42.5(pid=29166) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29166)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 14:00:25.818919 tst ping.py:22: Test FAILED (6.4 sec) 14:00:25.846698 run osmo-hlr_10.42.42.2(pid=29163): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29163)] 14:00:25.897079 run osmo-hlr_10.42.42.2(pid=29163): stdout: | (launched: 2022-12-13_14:00:22.655832) 14:00:25.948770 run osmo-hlr_10.42.42.2(pid=29163): stderr: | 20221213140022828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140022828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140022828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140022828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140022828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140022829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140022841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140022850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140022851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140022851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:26.000311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29162): Terminating (SIGTERM) 14:00:26.042168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29165): Terminating (SIGTERM) 14:00:26.083829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29168): Terminating (SIGTERM) 14:00:26.126345 --- ParallelTerminationStrategy: PID 29162 died... 14:00:26.146536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29162): Terminated: ok {rc=0} 14:00:26.192666 --- ParallelTerminationStrategy: PID 29165 died... 14:00:26.212423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29165): Terminated: ok {rc=0} 14:00:26.258339 --- ParallelTerminationStrategy: PID 29168 died... 14:00:26.278074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29168): Terminated: ok {rc=0} 14:00:26.367519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:00:27.454614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:27.466659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:00:27.535719 tst ping_idle_ping.py: using LAC 34427 14:00:27.653283 tst ping_idle_ping.py: using RAC 2 14:00:27.769815 tst ping_idle_ping.py: using CellId 34427 14:00:27.884708 tst ping_idle_ping.py: using BVCI 34428 14:00:27.992384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.003682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.014749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.025834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.036873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.047950 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.059077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:00:28.070178 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:00:28.185149 tst ping_idle_ping.py:24: start network... 14:00:28.382758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:28.843698 run create_hlr_db(pid=29170): Launched 14:00:28.964122 bus /gobi_6: Setting Powered False 14:00:30.023385 run create_hlr_db(pid=29170): Terminated: ok {rc=0} 14:00:30.458068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Launched 14:00:30.774870 run osmo-hlr_10.42.42.2(pid=29173): Launched 14:00:30.970915 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:31.698312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Launched 14:00:32.068486 run osmo-stp_10.42.42.5(pid=29176): Launched 14:00:32.190289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:00:32.852671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29178): Launched 14:00:32.974439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:00:33.241284 run patchelf(pid=29179): Launched 14:00:33.419023 run osmo-stp_10.42.42.5(pid=29176): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] 14:00:33.552542 run osmo-stp_10.42.42.5(pid=29176): stdout: | (launched: 2022-12-13_14:00:32.008564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:33.688296 run osmo-stp_10.42.42.5(pid=29176): stderr: | 20221213140032395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140032395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140032396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140032396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140032396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140032397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140032397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:33.823836 run osmo-stp_10.42.42.5(pid=29176): stdout: | (launched: 2022-12-13_14:00:32.008564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:33.954168 run osmo-stp_10.42.42.5(pid=29176): stderr: | 20221213140032395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140032395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140032396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140032396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140032396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140032397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140032397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:34.107708 run patchelf(pid=29179): Terminating (SIGINT) 14:00:34.285827 run patchelf(pid=29179): Terminated: ok {rc=0} 14:00:34.413850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29176): Process ended prematurely: osmo-stp_10.42.42.5(pid=29176) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:00:34.423511 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 14:00:34.451366 run osmo-hlr_10.42.42.2(pid=29173): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29173)] 14:00:34.501371 run osmo-hlr_10.42.42.2(pid=29173): stdout: | (launched: 2022-12-13_14:00:30.716147) 14:00:34.552717 run osmo-hlr_10.42.42.2(pid=29173): stderr: | 20221213140030998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140030998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140030998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140030998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140030998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140030998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140031020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140031031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140031031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140031031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:34.604615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Terminating (SIGTERM) 14:00:34.646534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Terminating (SIGTERM) 14:00:34.689029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29178): Terminating (SIGTERM) 14:00:34.731870 --- ParallelTerminationStrategy: PID 29172 died... 14:00:34.752233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Terminated: ok {rc=0} 14:00:34.798893 --- ParallelTerminationStrategy: PID 29175 died... 14:00:34.818714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Terminated: ok {rc=0} 14:00:34.865295 --- ParallelTerminationStrategy: PID 29178 died... 14:00:34.885544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29178): Terminated: ok {rc=0} 14:00:34.974530 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:00:36.274257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:36.280892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:00:36.310757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 14:00:36.350501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 14:00:36.440579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:00:36.469792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 14:00:36.507974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 14:00:37.108933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 14:00:37.161185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.172688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:00:37.240437 tst cs_paging_gprs_active.py: using LAC 34428 14:00:37.366262 tst cs_paging_gprs_active.py: using RAC 3 14:00:37.492071 tst cs_paging_gprs_active.py: using CellId 34428 14:00:37.618000 tst cs_paging_gprs_active.py: using BVCI 34429 14:00:37.737337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.748798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.760098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.771390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.783166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.794908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.806668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.818676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:37.830510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:00:37.947635 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:00:38.067873 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:00:38.285275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:38.607794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29184): Launched 14:00:38.887672 run iperf3-srv_10.42.42.10(pid=29185): Launched 14:00:39.008740 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:00:39.224196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:39.547316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29186): Launched 14:00:39.827499 run iperf3-srv_10.42.42.10(pid=29187): Launched 14:00:39.948806 tst cs_paging_gprs_active.py:38: start network... 14:00:40.165284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:40.665274 run create_hlr_db(pid=29188): Launched 14:00:40.788029 bus /gobi_6: Setting Powered False 14:00:41.851905 run create_hlr_db(pid=29188): Terminated: ok {rc=0} 14:00:42.283797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29190): Launched 14:00:42.586257 run osmo-hlr_10.42.42.2(pid=29191): Launched 14:00:42.701121 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:43.218251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29193): Launched 14:00:43.519009 run osmo-stp_10.42.42.5(pid=29194): Launched 14:00:43.634629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:00:44.153668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29196): Launched 14:00:44.269822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:00:44.532448 run patchelf(pid=29197): Launched 14:00:44.700372 run osmo-stp_10.42.42.5(pid=29194): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29194)] 14:00:44.828224 run osmo-stp_10.42.42.5(pid=29194): stdout: | (launched: 2022-12-13_14:00:43.463254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:44.957658 run osmo-stp_10.42.42.5(pid=29194): stderr: | 20221213140043632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140043632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140043633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140043633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140043634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140043634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140043634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:45.086945 run osmo-stp_10.42.42.5(pid=29194): stdout: | (launched: 2022-12-13_14:00:43.463254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:45.210309 run osmo-stp_10.42.42.5(pid=29194): stderr: | 20221213140043632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140043632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140043633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140043633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140043634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140043634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140043634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:45.356092 run patchelf(pid=29197): Terminating (SIGINT) 14:00:45.526196 run patchelf(pid=29197): Terminated: ok {rc=0} 14:00:45.648725 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29194): Process ended prematurely: osmo-stp_10.42.42.5(pid=29194) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29194)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 14:00:45.658326 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:00:45.685307 run osmo-hlr_10.42.42.2(pid=29191): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29191)] 14:00:45.732468 run osmo-hlr_10.42.42.2(pid=29191): stdout: | (launched: 2022-12-13_14:00:42.530550) 14:00:45.780930 run osmo-hlr_10.42.42.2(pid=29191): stderr: | 20221213140042703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140042703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140042703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140042703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140042704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140042704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140042714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140042723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140042723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140042723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:45.837826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29184): Terminating (SIGTERM) 14:00:45.894041 run iperf3-srv_10.42.42.10(pid=29185): Terminating (SIGTERM) 14:00:45.944795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29186): Terminating (SIGTERM) 14:00:45.986423 run iperf3-srv_10.42.42.10(pid=29187): Terminating (SIGTERM) 14:00:46.032116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29190): Terminating (SIGTERM) 14:00:46.073651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29193): Terminating (SIGTERM) 14:00:46.115959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29196): Terminating (SIGTERM) 14:00:46.157387 --- ParallelTerminationStrategy: PID 29184 died... 14:00:46.177239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29184): Terminated: ok {rc=0} 14:00:46.222194 --- ParallelTerminationStrategy: PID 29185 died... 14:00:46.241280 run iperf3-srv_10.42.42.10(pid=29185): Terminated {rc=256} 14:00:46.286352 --- ParallelTerminationStrategy: PID 29186 died... 14:00:46.305866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29186): Terminated: ok {rc=0} 14:00:46.350475 --- ParallelTerminationStrategy: PID 29187 died... 14:00:46.369844 run iperf3-srv_10.42.42.10(pid=29187): Terminated {rc=256} 14:00:46.414415 --- ParallelTerminationStrategy: PID 29190 died... 14:00:46.433834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29190): Terminated: ok {rc=0} 14:00:46.478492 --- ParallelTerminationStrategy: PID 29193 died... 14:00:46.497739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29193): Terminated: ok {rc=0} 14:00:46.542435 --- ParallelTerminationStrategy: PID 29196 died... 14:00:46.562443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29196): Terminated: ok {rc=0} 14:00:46.649986 bus /gobi_0: Setting Powered False 14:00:47.748595 bus /gobi_0: Setting Powered False 14:00:48.866216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 14:00:50.014926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.026989 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:00:50.094954 tst iperf3.py: using LAC 34429 14:00:50.220827 tst iperf3.py: using RAC 4 14:00:50.347099 tst iperf3.py: using CellId 34429 14:00:50.474069 tst iperf3.py: using BVCI 34430 14:00:50.591339 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.602916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.614313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.625726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.637473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.649089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.660736 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.672424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:50.684263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:00:50.801937 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:00:51.004234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:00:51.306807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29198): Launched 14:00:51.570998 run iperf3-srv_10.42.42.10(pid=29199): Launched 14:00:51.684582 tst iperf3.py:8: start network... 14:00:51.885699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:52.351562 run create_hlr_db(pid=29204): Launched 14:00:52.475805 bus /gobi_6: Setting Powered False 14:00:53.536416 run create_hlr_db(pid=29204): Terminated: ok {rc=0} 14:00:53.975784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Launched 14:00:54.299053 run osmo-hlr_10.42.42.2(pid=29207): Launched 14:00:54.423281 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:54.984645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Launched 14:00:55.307517 run osmo-stp_10.42.42.5(pid=29210): Launched 14:00:55.430011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:00:55.983776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29212): Launched 14:00:56.107292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:00:56.379841 run patchelf(pid=29213): Launched 14:00:56.558680 run osmo-stp_10.42.42.5(pid=29210): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] 14:00:56.695066 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-13_14:00:55.247989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:56.833072 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221213140055435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140055435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140055435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140055436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140055436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140055436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140055436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:56.971693 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-13_14:00:55.247989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:57.103761 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221213140055435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140055435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140055435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140055436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140055436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140055436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140055436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:57.260285 run patchelf(pid=29213): Terminating (SIGINT) 14:00:57.441806 run patchelf(pid=29213): Terminated: ok {rc=0} 14:00:57.572579 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 14:00:57.582900 tst iperf3.py:8: Test FAILED (7.6 sec) 14:00:57.611028 run osmo-hlr_10.42.42.2(pid=29207): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29207)] 14:00:57.661228 run osmo-hlr_10.42.42.2(pid=29207): stdout: | (launched: 2022-12-13_14:00:54.239969) 14:00:57.712684 run osmo-hlr_10.42.42.2(pid=29207): stderr: | 20221213140054434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140054434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140054434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140054434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140054434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140054434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140054446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140054455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140054455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140054455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:57.764592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29198): Terminating (SIGTERM) 14:00:57.806405 run iperf3-srv_10.42.42.10(pid=29199): Terminating (SIGTERM) 14:00:57.848267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminating (SIGTERM) 14:00:57.890933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminating (SIGTERM) 14:00:57.932842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29212): Terminating (SIGTERM) 14:00:57.975357 --- ParallelTerminationStrategy: PID 29198 died... 14:00:57.995717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29198): Terminated: ok {rc=0} 14:00:58.042012 --- ParallelTerminationStrategy: PID 29199 died... 14:00:58.061756 run iperf3-srv_10.42.42.10(pid=29199): Terminated {rc=256} 14:00:58.107906 --- ParallelTerminationStrategy: PID 29206 died... 14:00:58.127634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminated: ok {rc=0} 14:00:58.173690 --- ParallelTerminationStrategy: PID 29209 died... 14:00:58.193914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminated: ok {rc=0} 14:00:58.240074 --- ParallelTerminationStrategy: PID 29212 died... 14:00:58.259921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29212): Terminated: ok {rc=0} 14:00:58.347956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 14:00:59.498482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:00:59.510609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:00:59.577254 tst iperf3m4.py: using LAC 34430 14:00:59.703481 tst iperf3m4.py: using RAC 5 14:00:59.827846 tst iperf3m4.py: using CellId 34430 14:00:59.952299 tst iperf3m4.py: using BVCI 34431 14:01:00.069499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.081081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.092404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.103760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.115496 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.127126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.138973 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.150591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:00.162563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:00.280431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:00.398757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:00.519132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:00.637673 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:01:00.847970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:01:01.189695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29215): Launched 14:01:01.483051 run iperf3-srv_10.42.42.10(pid=29216): Launched 14:01:01.614234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:01:01.821235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:01:02.137899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29217): Launched 14:01:02.430998 run iperf3-srv_10.42.42.10(pid=29218): Launched 14:01:02.552856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:01:02.770857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:01:03.096579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29219): Launched 14:01:03.377284 run iperf3-srv_10.42.42.10(pid=29220): Launched 14:01:03.498541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:01:03.714852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:01:04.038179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29221): Launched 14:01:04.319273 run iperf3-srv_10.42.42.10(pid=29222): Launched 14:01:04.441754 tst iperf3m4.py:8: start network... 14:01:04.657925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:05.158332 run create_hlr_db(pid=29223): Launched 14:01:05.281610 bus /gobi_6: Setting Powered False 14:01:06.345350 run create_hlr_db(pid=29223): Terminated: ok {rc=0} 14:01:06.778316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Launched 14:01:07.082792 run osmo-hlr_10.42.42.2(pid=29226): Launched 14:01:07.196929 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:07.720289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Launched 14:01:08.021566 run osmo-stp_10.42.42.5(pid=29229): Launched 14:01:08.135865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:01:08.658008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29231): Launched 14:01:08.772532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:01:09.026088 run patchelf(pid=29232): Launched 14:01:09.192451 run osmo-stp_10.42.42.5(pid=29229): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] 14:01:09.318890 run osmo-stp_10.42.42.5(pid=29229): stdout: | (launched: 2022-12-13_14:01:07.965605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:09.446963 run osmo-stp_10.42.42.5(pid=29229): stderr: | 20221213140108131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140108132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140108132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140108132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140108133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140108133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140108133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:09.574863 run osmo-stp_10.42.42.5(pid=29229): stdout: | (launched: 2022-12-13_14:01:07.965605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:09.697515 run osmo-stp_10.42.42.5(pid=29229): stderr: | 20221213140108131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140108132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140108132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140108132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140108133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140108133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140108133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:09.842869 run patchelf(pid=29232): Terminating (SIGINT) 14:01:10.011869 run patchelf(pid=29232): Terminated: ok {rc=0} 14:01:10.133323 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29229): Process ended prematurely: osmo-stp_10.42.42.5(pid=29229) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 14:01:10.142920 tst iperf3m4.py:8: Test FAILED (10.7 sec) 14:01:10.170093 run osmo-hlr_10.42.42.2(pid=29226): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29226)] 14:01:10.217177 run osmo-hlr_10.42.42.2(pid=29226): stdout: | (launched: 2022-12-13_14:01:07.026603) 14:01:10.265642 run osmo-hlr_10.42.42.2(pid=29226): stderr: | 20221213140107200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140107200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140107201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140107201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140107201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140107201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140107213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140107222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140107222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140107222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:10.314862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29215): Terminating (SIGTERM) 14:01:10.354274 run iperf3-srv_10.42.42.10(pid=29216): Terminating (SIGTERM) 14:01:10.393381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29217): Terminating (SIGTERM) 14:01:10.432713 run iperf3-srv_10.42.42.10(pid=29218): Terminating (SIGTERM) 14:01:10.471801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29219): Terminating (SIGTERM) 14:01:10.511635 run iperf3-srv_10.42.42.10(pid=29220): Terminating (SIGTERM) 14:01:10.550626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29221): Terminating (SIGTERM) 14:01:10.590501 run iperf3-srv_10.42.42.10(pid=29222): Terminating (SIGTERM) 14:01:10.629518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Terminating (SIGTERM) 14:01:10.668807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Terminating (SIGTERM) 14:01:10.708024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29231): Terminating (SIGTERM) 14:01:10.747448 --- ParallelTerminationStrategy: PID 29215 died... 14:01:10.766555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29215): Terminated: ok {rc=0} 14:01:10.810074 --- ParallelTerminationStrategy: PID 29216 died... 14:01:10.828513 run iperf3-srv_10.42.42.10(pid=29216): Terminated {rc=256} 14:01:10.871792 --- ParallelTerminationStrategy: PID 29217 died... 14:01:10.890195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29217): Terminated: ok {rc=0} 14:01:10.933639 --- ParallelTerminationStrategy: PID 29218 died... 14:01:10.952053 run iperf3-srv_10.42.42.10(pid=29218): Terminated {rc=256} 14:01:10.995419 --- ParallelTerminationStrategy: PID 29219 died... 14:01:11.013874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29219): Terminated: ok {rc=0} 14:01:11.057240 --- ParallelTerminationStrategy: PID 29220 died... 14:01:11.075551 run iperf3-srv_10.42.42.10(pid=29220): Terminated {rc=256} 14:01:11.119131 --- ParallelTerminationStrategy: PID 29221 died... 14:01:11.137671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29221): Terminated: ok {rc=0} 14:01:11.180830 --- ParallelTerminationStrategy: PID 29222 died... 14:01:11.199632 run iperf3-srv_10.42.42.10(pid=29222): Terminated {rc=256} 14:01:11.242912 --- ParallelTerminationStrategy: PID 29225 died... 14:01:11.261388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Terminated: ok {rc=0} 14:01:11.304645 --- ParallelTerminationStrategy: PID 29228 died... 14:01:11.323193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Terminated: ok {rc=0} 14:01:11.366589 --- ParallelTerminationStrategy: PID 29231 died... 14:01:11.385026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29231): Terminated: ok {rc=0} 14:01:11.468247 bus /gobi_4: Setting Powered False 14:01:12.566204 bus /gobi_4: Setting Powered False 14:01:13.681702 bus /gobi_1: Setting Powered False 14:01:14.779490 bus /gobi_1: Setting Powered False 14:01:15.919200 bus /gobi_0: Setting Powered False 14:01:17.023363 bus /gobi_0: Setting Powered False 14:01:18.142400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 14:01:19.244731 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.256508 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:01:19.327877 tst ping.py: using LAC 34431 14:01:19.455798 tst ping.py: using RAC 6 14:01:19.585724 tst ping.py: using CellId 34431 14:01:19.701295 tst ping.py: using BVCI 34432 14:01:19.808072 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.819483 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.830394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.841314 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.852598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.863939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.875367 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:19.886812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:20.002987 tst ping.py:19: start network... 14:01:20.199674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:20.655067 run create_hlr_db(pid=29233): Launched 14:01:20.775772 bus /gobi_6: Setting Powered False 14:01:21.835525 run create_hlr_db(pid=29233): Terminated: ok {rc=0} 14:01:22.247604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Launched 14:01:22.541841 run osmo-hlr_10.42.42.2(pid=29236): Launched 14:01:22.652680 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:23.180500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Launched 14:01:23.474897 run osmo-stp_10.42.42.5(pid=29239): Launched 14:01:23.585569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:01:24.093272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29241): Launched 14:01:24.205833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:01:24.453758 run patchelf(pid=29242): Launched 14:01:24.619920 run osmo-stp_10.42.42.5(pid=29239): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29239)] 14:01:24.745686 run osmo-stp_10.42.42.5(pid=29239): stdout: | (launched: 2022-12-13_14:01:23.420027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:24.873160 run osmo-stp_10.42.42.5(pid=29239): stderr: | 20221213140123589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140123589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140123589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140123590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140123590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140123590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140123590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:25.000469 run osmo-stp_10.42.42.5(pid=29239): stdout: | (launched: 2022-12-13_14:01:23.420027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:25.121829 run osmo-stp_10.42.42.5(pid=29239): stderr: | 20221213140123589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140123589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140123589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140123590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140123590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140123590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140123590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:25.265768 run patchelf(pid=29242): Terminating (SIGINT) 14:01:25.432427 run patchelf(pid=29242): Terminated: ok {rc=0} 14:01:25.552364 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29239): Process ended prematurely: osmo-stp_10.42.42.5(pid=29239) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29239)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 14:01:25.561375 tst ping.py:22: Test FAILED (6.3 sec) 14:01:25.587711 run osmo-hlr_10.42.42.2(pid=29236): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29236)] 14:01:25.635307 run osmo-hlr_10.42.42.2(pid=29236): stdout: | (launched: 2022-12-13_14:01:22.487295) 14:01:25.684044 run osmo-hlr_10.42.42.2(pid=29236): stderr: | 20221213140122661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140122661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140122661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140122661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140122661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140122661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140122674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140122683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140122683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140122684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:25.732794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Terminating (SIGTERM) 14:01:25.771924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Terminating (SIGTERM) 14:01:25.810989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29241): Terminating (SIGTERM) 14:01:25.850362 --- ParallelTerminationStrategy: PID 29235 died... 14:01:25.869348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29235): Terminated: ok {rc=0} 14:01:25.912659 --- ParallelTerminationStrategy: PID 29238 died... 14:01:25.930892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29238): Terminated: ok {rc=0} 14:01:25.974361 --- ParallelTerminationStrategy: PID 29241 died... 14:01:25.992715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29241): Terminated: ok {rc=0} 14:01:26.077997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 14:01:27.166201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.179272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:01:27.253540 tst ping_idle_ping.py: using LAC 34432 14:01:27.377355 tst ping_idle_ping.py: using RAC 7 14:01:27.498903 tst ping_idle_ping.py: using CellId 34432 14:01:27.621198 tst ping_idle_ping.py: using BVCI 34433 14:01:27.735398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.747042 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.758591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.770642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.782490 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.794501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.806551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:01:27.818306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:01:27.935469 tst ping_idle_ping.py:24: start network... 14:01:28.150275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:28.642275 run create_hlr_db(pid=29243): Launched 14:01:28.764849 bus /gobi_6: Setting Powered False 14:01:29.828521 run create_hlr_db(pid=29243): Terminated: ok {rc=0} 14:01:30.252738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29245): Launched 14:01:30.548162 run osmo-hlr_10.42.42.2(pid=29246): Launched 14:01:30.661384 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:31.233513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29248): Launched 14:01:31.570422 run osmo-stp_10.42.42.5(pid=29249): Launched 14:01:31.795057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:01:32.422070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29251): Launched 14:01:32.543321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:01:32.810945 run patchelf(pid=29252): Launched 14:01:32.989410 run osmo-stp_10.42.42.5(pid=29249): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29249)] 14:01:33.123496 run osmo-stp_10.42.42.5(pid=29249): stdout: | (launched: 2022-12-13_14:01:31.509245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:33.259513 run osmo-stp_10.42.42.5(pid=29249): stderr: | 20221213140131734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140131734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140131734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140131734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140131735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140131741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140131741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:33.395114 run osmo-stp_10.42.42.5(pid=29249): stdout: | (launched: 2022-12-13_14:01:31.509245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:33.525041 run osmo-stp_10.42.42.5(pid=29249): stderr: | 20221213140131734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140131734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140131734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140131734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140131735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140131741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140131741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:33.678400 run patchelf(pid=29252): Terminating (SIGINT) 14:01:33.855908 run patchelf(pid=29252): Terminated: ok {rc=0} 14:01:33.984345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29249): Process ended prematurely: osmo-stp_10.42.42.5(pid=29249) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29249)] [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 14:01:33.994060 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 14:01:34.021946 run osmo-hlr_10.42.42.2(pid=29246): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29246)] 14:01:34.071975 run osmo-hlr_10.42.42.2(pid=29246): stdout: | (launched: 2022-12-13_14:01:30.493527) 14:01:34.123498 run osmo-hlr_10.42.42.2(pid=29246): stderr: | 20221213140130665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140130665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140130665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140130665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140130665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140130665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140130678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140130688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140130688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140130688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:34.175703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29245): Terminating (SIGTERM) 14:01:34.217471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29248): Terminating (SIGTERM) 14:01:34.259502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29251): Terminating (SIGTERM) 14:01:34.301824 --- ParallelTerminationStrategy: PID 29245 died... 14:01:34.322090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29245): Terminated: ok {rc=0} 14:01:34.368403 --- ParallelTerminationStrategy: PID 29248 died... 14:01:34.388199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29248): Terminated: ok {rc=0} 14:01:34.433855 --- ParallelTerminationStrategy: PID 29251 died... 14:01:34.453547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29251): Terminated: ok {rc=0} 14:01:34.542645 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:01:35.847211 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:35.854508 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:01:35.884473 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:01:35.920633 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:01:35.974814 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:01:36.004617 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:01:36.040273 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:01:36.598847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:01:36.604643 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:36.616416 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:01:36.682353 tst switch_tch_pdch.py: using LAC 34433 14:01:36.798977 tst switch_tch_pdch.py: using RAC 8 14:01:36.916769 tst switch_tch_pdch.py: using CellId 34433 14:01:37.032933 tst switch_tch_pdch.py: using BVCI 34434 14:01:37.141526 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.152802 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.164015 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.175217 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.186409 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.197609 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.208755 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:01:37.219894 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:37.341680 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:37.457934 tst switch_tch_pdch.py:51: start network... 14:01:37.655857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:38.111929 run create_hlr_db(pid=29256): Launched 14:01:38.232073 bus /gobi_6: Setting Powered False 14:01:39.291967 run create_hlr_db(pid=29256): Terminated: ok {rc=0} 14:01:39.726213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29258): Launched 14:01:40.044173 run osmo-hlr_10.42.42.2(pid=29259): Launched 14:01:40.163529 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:40.706236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29261): Launched 14:01:41.022537 run osmo-stp_10.42.42.5(pid=29262): Launched 14:01:41.142540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:01:41.686480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29264): Launched 14:01:41.808167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:01:42.075031 run patchelf(pid=29265): Launched 14:01:42.250768 run osmo-stp_10.42.42.5(pid=29262): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29262)] 14:01:42.384265 run osmo-stp_10.42.42.5(pid=29262): stdout: | (launched: 2022-12-13_14:01:40.963983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:42.519631 run osmo-stp_10.42.42.5(pid=29262): stderr: | 20221213140141151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140141151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140141152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140141152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140141153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140141153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140141153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:42.655054 run osmo-stp_10.42.42.5(pid=29262): stdout: | (launched: 2022-12-13_14:01:40.963983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:42.784630 run osmo-stp_10.42.42.5(pid=29262): stderr: | 20221213140141151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140141151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140141152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140141152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140141153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140141153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140141153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:42.938546 run patchelf(pid=29265): Terminating (SIGINT) 14:01:43.115821 run patchelf(pid=29265): Terminated: ok {rc=0} 14:01:43.243667 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29262): Process ended prematurely: osmo-stp_10.42.42.5(pid=29262) [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29262)] [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:01:43.253376 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 14:01:43.281215 run osmo-hlr_10.42.42.2(pid=29259): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29259)] 14:01:43.331525 run osmo-hlr_10.42.42.2(pid=29259): stdout: | (launched: 2022-12-13_14:01:39.986293) 14:01:43.383108 run osmo-hlr_10.42.42.2(pid=29259): stderr: | 20221213140140180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140140180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140140180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140140181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140140181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140140181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140140194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140140202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140140202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140140202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:43.434957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29258): Terminating (SIGTERM) 14:01:43.476556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29261): Terminating (SIGTERM) 14:01:43.518663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29264): Terminating (SIGTERM) 14:01:43.560556 --- ParallelTerminationStrategy: PID 29258 died... 14:01:43.580566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29258): Terminated: ok {rc=0} 14:01:43.626775 --- ParallelTerminationStrategy: PID 29261 died... 14:01:43.646576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29261): Terminated: ok {rc=0} 14:01:43.692343 --- ParallelTerminationStrategy: PID 29264 died... 14:01:43.712096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29264): Terminated: ok {rc=0} 14:01:43.799317 bus /gobi_0: Setting Powered False 14:01:44.896615 bus /gobi_0: Setting Powered False 14:01:46.013733 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 14:01:47.279292 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:47.286947 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 14:01:47.317248 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 14:01:47.353226 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 14:01:47.407484 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 14:01:47.437067 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 14:01:47.472375 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 14:01:48.031811 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 14:01:48.037180 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.048668 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 14:01:48.116763 tst switch_tch_pdch.py: using LAC 34434 14:01:48.241376 tst switch_tch_pdch.py: using RAC 9 14:01:48.358218 tst switch_tch_pdch.py: using CellId 34434 14:01:48.484449 tst switch_tch_pdch.py: using BVCI 34435 14:01:48.599482 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.611130 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.622633 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.634032 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.645661 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.657442 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.669343 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:01:48.680999 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:01:48.798197 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:01:48.918062 tst switch_tch_pdch.py:51: start network... 14:01:49.130314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:49.589704 run create_hlr_db(pid=29269): Launched 14:01:49.710911 bus /gobi_6: Setting Powered False 14:01:50.773652 run create_hlr_db(pid=29269): Terminated: ok {rc=0} 14:01:51.186687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Launched 14:01:51.501990 run osmo-hlr_10.42.42.2(pid=29272): Launched 14:01:51.623410 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:52.145653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Launched 14:01:52.465458 run osmo-stp_10.42.42.5(pid=29275): Launched 14:01:52.586190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:01:53.106728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29277): Launched 14:01:53.229354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:01:53.496014 run patchelf(pid=29278): Launched 14:01:53.671818 run osmo-stp_10.42.42.5(pid=29275): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29275)] 14:01:53.805829 run osmo-stp_10.42.42.5(pid=29275): stdout: | (launched: 2022-12-13_14:01:52.407259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:53.941894 run osmo-stp_10.42.42.5(pid=29275): stderr: | 20221213140152596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140152596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140152596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140152597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140152597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140152597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140152597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:54.077955 run osmo-stp_10.42.42.5(pid=29275): stdout: | (launched: 2022-12-13_14:01:52.407259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:54.207529 run osmo-stp_10.42.42.5(pid=29275): stderr: | 20221213140152596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140152596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140152596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140152597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140152597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140152597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140152597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:54.360744 run patchelf(pid=29278): Terminating (SIGINT) 14:01:54.538545 run patchelf(pid=29278): Terminated: ok {rc=0} 14:01:54.666712 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29275): Process ended prematurely: osmo-stp_10.42.42.5(pid=29275) [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29275)] [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 14:01:54.676086 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 14:01:54.703888 run osmo-hlr_10.42.42.2(pid=29272): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29272)] 14:01:54.753663 run osmo-hlr_10.42.42.2(pid=29272): stdout: | (launched: 2022-12-13_14:01:51.444193) 14:01:54.805505 run osmo-hlr_10.42.42.2(pid=29272): stderr: | 20221213140151638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140151638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140151638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140151638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140151638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140151639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140151651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140151660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140151660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140151660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:54.857491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Terminating (SIGTERM) 14:01:54.899676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Terminating (SIGTERM) 14:01:54.942299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29277): Terminating (SIGTERM) 14:01:54.984445 --- ParallelTerminationStrategy: PID 29271 died... 14:01:55.004753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29271): Terminated: ok {rc=0} 14:01:55.050989 --- ParallelTerminationStrategy: PID 29274 died... 14:01:55.070755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29274): Terminated: ok {rc=0} 14:01:55.116826 --- ParallelTerminationStrategy: PID 29277 died... 14:01:55.136898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29277): Terminated: ok {rc=0} 14:01:55.225637 bus /gobi_0: Setting Powered False 14:01:56.324289 bus /gobi_0: Setting Powered False 14:01:57.441639 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_sms:nanobts --------------------------------------------------------------------- 14:01:58.687073 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:58.690717 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 14:01:58.713877 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 14:01:58.720448 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 14:01:58.769695 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 14:01:58.793103 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 14:01:58.799628 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 14:01:59.341695 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 14:01:59.347176 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 14:01:59.358497 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 14:01:59.400708 tst mo_mt_sms.py: using LAC 34435 14:01:59.523791 tst mo_mt_sms.py: using RAC 10 14:01:59.646852 tst mo_mt_sms.py: using CellId 34435 14:01:59.769348 tst mo_mt_sms.py: using BVCI 34436 14:01:59.883530 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 14:01:59.998493 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 14:02:00.116749 tst mo_mt_sms.py:9: start nitb and bts... 14:02:00.329729 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:02:00.989622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29283): Launched 14:02:01.315121 run osmo-nitb_10.42.42.2(pid=29284): Launched 14:02:01.502535 run osmo-nitb_10.42.42.2(pid=29284): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29284)] 14:02:01.640447 run osmo-nitb_10.42.42.2(pid=29284): stdout: | (launched: 2022-12-13_14:02:01.259592) 14:02:01.779529 run osmo-nitb_10.42.42.2(pid=29284): stderr: | (launched: 2022-12-13_14:02:01.304163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:02:01.917768 run osmo-nitb_10.42.42.2(pid=29284): stdout: | (launched: 2022-12-13_14:02:01.259592) 14:02:02.050594 run osmo-nitb_10.42.42.2(pid=29284): stderr: | (launched: 2022-12-13_14:02:01.304163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29284) [trial-2390↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29284)] 14:02:02.449670 tst osmo-nitb_10.42.42.2(pid=29284): stdout: | (launched: 2022-12-13_14:02:01.259592) 14:02:02.569229 tst osmo-nitb_10.42.42.2(pid=29284): stderr: | (launched: 2022-12-13_14:02:01.304163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:02:02.709162 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29284) [trial-2390↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29284)] [trial-2390↪nitb_sms:nanobts↪mo_mt_sms.py:11] 14:02:02.717517 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 14:02:02.723927 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29283): Terminating (SIGTERM) 14:02:02.931794 --- ParallelTerminationStrategy: PID 29283 died... 14:02:02.952153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29283): Terminated: ok {rc=0} 14:02:03.038028 bus /sierra_3: Setting Powered False 14:02:04.137120 bus /sierra_3: Setting Powered False 14:02:05.252585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:nanobts+band-1900 --------------------------------------------------------------------- 14:02:06.441177 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:06.446946 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 14:02:06.471063 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 14:02:06.499350 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 14:02:06.553471 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 14:02:06.578506 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 14:02:06.606353 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 14:02:07.152935 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 14:02:07.158225 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.169823 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:02:07.209717 tst mo_mt_sms.py: using LAC 34436 14:02:07.337545 tst mo_mt_sms.py: using RAC 11 14:02:07.455224 tst mo_mt_sms.py: using CellId 34436 14:02:07.572753 tst mo_mt_sms.py: using BVCI 34437 14:02:07.679831 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.690672 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.701493 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.712034 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.722565 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:07.732934 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 14:02:07.850329 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 14:02:07.965432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:08.422645 run create_hlr_db(pid=29289): Launched 14:02:08.545502 bus /sierra_2: Setting Powered False 14:02:09.604750 run create_hlr_db(pid=29289): Terminated: ok {rc=0} 14:02:10.038780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29291): Launched 14:02:10.355897 run osmo-hlr_10.42.42.2(pid=29292): Launched 14:02:10.476435 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:11.026184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29294): Launched 14:02:11.326156 run osmo-stp_10.42.42.5(pid=29295): Launched 14:02:11.437289 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:11.972407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29297): Launched 14:02:12.268401 run osmo-msc_10.42.42.6(pid=29298): Launched 14:02:12.434029 run osmo-stp_10.42.42.5(pid=29295): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29295)] 14:02:12.558870 run osmo-stp_10.42.42.5(pid=29295): stdout: | (launched: 2022-12-13_14:02:11.271364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:12.684834 run osmo-stp_10.42.42.5(pid=29295): stderr: | 20221213140211438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140211438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140211439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140211439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140211440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140211440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140211440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:12.807558 run osmo-stp_10.42.42.5(pid=29295): stdout: | (launched: 2022-12-13_14:02:11.271364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:12.924606 run osmo-stp_10.42.42.5(pid=29295): stderr: | 20221213140211438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140211438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140211439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140211439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140211440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140211440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140211440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:13.065455 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29295): Process ended prematurely: osmo-stp_10.42.42.5(pid=29295) [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29295)] [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 14:02:13.073937 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 14:02:13.099633 run osmo-hlr_10.42.42.2(pid=29292): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29292)] 14:02:13.147201 run osmo-hlr_10.42.42.2(pid=29292): stdout: | (launched: 2022-12-13_14:02:10.297878) 14:02:13.196020 run osmo-hlr_10.42.42.2(pid=29292): stderr: | 20221213140210491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140210491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140210491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140210491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140210491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140210491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140210503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140210512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140210512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140210512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:13.264110 run osmo-msc_10.42.42.6(pid=29298): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29298)] 14:02:13.311251 run osmo-msc_10.42.42.6(pid=29298): stdout: | (launched: 2022-12-13_14:02:12.213346) 14:02:13.360704 run osmo-msc_10.42.42.6(pid=29298): stderr: | 20221213140212481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140212482 DLGLOBAL DEBUG validating counter group 0x7f0caed05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140212482 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140212482 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140212482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140212482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140212484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140212484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140212484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140212485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:13.409956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29291): Terminating (SIGTERM) 14:02:13.449349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29294): Terminating (SIGTERM) 14:02:13.488567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29297): Terminating (SIGTERM) 14:02:13.528111 --- ParallelTerminationStrategy: PID 29291 died... 14:02:13.547051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29291): Terminated: ok {rc=0} 14:02:13.590924 --- ParallelTerminationStrategy: PID 29294 died... 14:02:13.609349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29294): Terminated: ok {rc=0} 14:02:13.652411 --- ParallelTerminationStrategy: PID 29297 died... 14:02:13.670873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29297): Terminated: ok {rc=0} 14:02:13.753711 bus /sierra_3: Setting Powered False 14:02:14.848767 bus /sierra_3: Setting Powered False 14:02:15.974978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 14:02:17.210959 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:17.215609 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 14:02:17.240380 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 14:02:17.248183 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 14:02:17.282988 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 14:02:17.307715 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 14:02:17.314805 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 14:02:17.833931 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 14:02:17.838832 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 14:02:17.849607 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:02:17.885920 tst assert_extension.py: using LAC 34437 14:02:18.001377 tst assert_extension.py: using RAC 12 14:02:18.120672 tst assert_extension.py: using CellId 34437 14:02:18.238816 tst assert_extension.py: using BVCI 34438 14:02:18.347989 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 14:02:18.467355 tst assert_extension.py:10: start nitb and bts... 14:02:18.680591 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:02:19.326754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29303): Launched 14:02:19.644366 run osmo-nitb_10.42.42.2(pid=29304): Launched 14:02:19.819273 run osmo-nitb_10.42.42.2(pid=29304): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29304)] 14:02:19.961657 run osmo-nitb_10.42.42.2(pid=29304): stdout: | (launched: 2022-12-13_14:02:19.586348) 14:02:20.104853 run osmo-nitb_10.42.42.2(pid=29304): stderr: | (launched: 2022-12-13_14:02:19.633565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:02:20.248217 run osmo-nitb_10.42.42.2(pid=29304): stdout: | (launched: 2022-12-13_14:02:19.586348) 14:02:20.386146 run osmo-nitb_10.42.42.2(pid=29304): stderr: | (launched: 2022-12-13_14:02:19.633565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29304): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29304) [trial-2390↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29304)] 14:02:20.763783 tst osmo-nitb_10.42.42.2(pid=29304): stdout: | (launched: 2022-12-13_14:02:19.586348) 14:02:20.891121 tst osmo-nitb_10.42.42.2(pid=29304): stderr: | (launched: 2022-12-13_14:02:19.633565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:02:21.042135 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29304): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29304) [trial-2390↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29304)] [trial-2390↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 14:02:21.051477 tst assert_extension.py:12: Test FAILED (3.2 sec) 14:02:21.058663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29303): Terminating (SIGTERM) 14:02:21.269343 --- ParallelTerminationStrategy: PID 29303 died... 14:02:21.290600 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29303): Terminated: ok {rc=0} 14:02:21.380185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:nanobts+band-1900 --------------------------------------------------------------------- 14:02:22.545917 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:22.551474 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 14:02:22.575901 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 14:02:22.605827 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 14:02:22.641883 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 14:02:22.667180 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 14:02:22.695351 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 14:02:23.224137 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 14:02:23.229686 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.240632 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:02:23.281112 tst assert_extension.py: using LAC 34438 14:02:23.406417 tst assert_extension.py: using RAC 13 14:02:23.533157 tst assert_extension.py: using CellId 34438 14:02:23.651621 tst assert_extension.py: using BVCI 34439 14:02:23.759730 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.770373 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.780832 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.791746 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.802207 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:02:23.812629 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 14:02:23.926338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:24.381733 run create_hlr_db(pid=29308): Launched 14:02:24.502520 bus /sierra_2: Setting Powered False 14:02:25.561605 run create_hlr_db(pid=29308): Terminated: ok {rc=0} 14:02:25.995480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29310): Launched 14:02:26.313728 run osmo-hlr_10.42.42.2(pid=29311): Launched 14:02:26.436530 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:26.986280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29313): Launched 14:02:27.303506 run osmo-stp_10.42.42.5(pid=29314): Launched 14:02:27.426135 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:27.999278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29316): Launched 14:02:28.315889 run osmo-msc_10.42.42.6(pid=29317): Launched 14:02:28.492463 run osmo-stp_10.42.42.5(pid=29314): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29314)] 14:02:28.626510 run osmo-stp_10.42.42.5(pid=29314): stdout: | (launched: 2022-12-13_14:02:27.245481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:28.760900 run osmo-stp_10.42.42.5(pid=29314): stderr: | 20221213140227431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140227432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140227432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140227432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140227433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140227433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140227433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:28.893314 run osmo-stp_10.42.42.5(pid=29314): stdout: | (launched: 2022-12-13_14:02:27.245481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:29.019804 run osmo-stp_10.42.42.5(pid=29314): stderr: | 20221213140227431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140227432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140227432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140227432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140227433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140227433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140227433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:29.170604 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29314): Process ended prematurely: osmo-stp_10.42.42.5(pid=29314) [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29314)] [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py:17] 14:02:29.179451 tst assert_extension.py:17: Test FAILED (5.9 sec) 14:02:29.206566 run osmo-hlr_10.42.42.2(pid=29311): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29311)] 14:02:29.257113 run osmo-hlr_10.42.42.2(pid=29311): stdout: | (launched: 2022-12-13_14:02:26.255570) 14:02:29.308845 run osmo-hlr_10.42.42.2(pid=29311): stderr: | 20221213140226447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140226447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140226447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140226447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140226447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140226447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140226459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140226467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140226468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140226468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:29.381331 run osmo-msc_10.42.42.6(pid=29317): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29317)] 14:02:29.431037 run osmo-msc_10.42.42.6(pid=29317): stdout: | (launched: 2022-12-13_14:02:28.257584) 14:02:29.482701 run osmo-msc_10.42.42.6(pid=29317): stderr: | 20221213140228575 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140228575 DLGLOBAL DEBUG validating counter group 0x7f1261e3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140228575 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140228575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140228576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140228576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140228578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140228578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140228578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140228578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:29.534918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29310): Terminating (SIGTERM) 14:02:29.576690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29313): Terminating (SIGTERM) 14:02:29.618489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29316): Terminating (SIGTERM) 14:02:29.661104 --- ParallelTerminationStrategy: PID 29310 died... 14:02:29.681298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29310): Terminated: ok {rc=0} 14:02:29.727276 --- ParallelTerminationStrategy: PID 29313 died... 14:02:29.747007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29313): Terminated: ok {rc=0} 14:02:29.792917 --- ParallelTerminationStrategy: PID 29316 died... 14:02:29.812630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29316): Terminated: ok {rc=0} 14:02:29.899753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:02:31.124036 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:31.135746 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:02:31.168205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:02:31.202086 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:02:31.261612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:02:31.287591 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:02:31.318220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:02:31.864102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:02:31.927746 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:31.943109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:02:32.013207 tst mo_mt_call.py: using LAC 34439 14:02:32.174849 tst mo_mt_call.py: using RAC 14 14:02:32.300177 tst mo_mt_call.py: using CellId 34439 14:02:32.422271 tst mo_mt_call.py: using BVCI 34440 14:02:32.533254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:32.544568 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:32.555757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:32.566742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:32.578025 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:32.589508 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:02:32.704520 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:02:32.821576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:33.287492 run create_hlr_db(pid=29322): Launched 14:02:33.410865 bus /sierra_2: Setting Powered False 14:02:34.470472 run create_hlr_db(pid=29322): Terminated: ok {rc=0} 14:02:34.909308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Launched 14:02:35.231213 run osmo-hlr_10.42.42.2(pid=29325): Launched 14:02:35.355154 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:35.905386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29327): Launched 14:02:36.228162 run osmo-stp_10.42.42.5(pid=29328): Launched 14:02:36.350156 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:36.931401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29330): Launched 14:02:37.253574 run osmo-msc_10.42.42.6(pid=29331): Launched 14:02:37.435343 run osmo-stp_10.42.42.5(pid=29328): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29328)] 14:02:37.572573 run osmo-stp_10.42.42.5(pid=29328): stdout: | (launched: 2022-12-13_14:02:36.169095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:37.709058 run osmo-stp_10.42.42.5(pid=29328): stderr: | 20221213140236354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140236355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140236355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140236355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140236356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140236356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140236356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:37.843448 run osmo-stp_10.42.42.5(pid=29328): stdout: | (launched: 2022-12-13_14:02:36.169095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:37.972176 run osmo-stp_10.42.42.5(pid=29328): stderr: | 20221213140236354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140236355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140236355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140236355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140236356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140236356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140236356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:38.125170 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29328): Process ended prematurely: osmo-stp_10.42.42.5(pid=29328) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29328)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:02:38.134722 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:02:38.162276 run osmo-hlr_10.42.42.2(pid=29325): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29325)] 14:02:38.212196 run osmo-hlr_10.42.42.2(pid=29325): stdout: | (launched: 2022-12-13_14:02:35.171947) 14:02:38.263438 run osmo-hlr_10.42.42.2(pid=29325): stderr: | 20221213140235365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140235365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140235365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140235365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140235365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140235365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140235376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140235386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140235386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140235386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:38.335183 run osmo-msc_10.42.42.6(pid=29331): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29331)] 14:02:38.384490 run osmo-msc_10.42.42.6(pid=29331): stdout: | (launched: 2022-12-13_14:02:37.194420) 14:02:38.435582 run osmo-msc_10.42.42.6(pid=29331): stderr: | 20221213140237511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140237511 DLGLOBAL DEBUG validating counter group 0x7f12f63e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140237511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140237511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140237512 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140237512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140237514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140237514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140237514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140237514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:38.486898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Terminating (SIGTERM) 14:02:38.528195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29327): Terminating (SIGTERM) 14:02:38.570062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29330): Terminating (SIGTERM) 14:02:38.611725 --- ParallelTerminationStrategy: PID 29324 died... 14:02:38.631808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Terminated: ok {rc=0} 14:02:38.677494 --- ParallelTerminationStrategy: PID 29327 died... 14:02:38.696874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29327): Terminated: ok {rc=0} 14:02:38.742646 --- ParallelTerminationStrategy: PID 29330 died... 14:02:38.762256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29330): Terminated: ok {rc=0} 14:02:38.848797 bus /sierra_3: Setting Powered False 14:02:39.946825 bus /sierra_3: Setting Powered False 14:02:41.062463 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:02:42.211110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.223611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:02:42.289398 tst mo_mt_call_osmux.py: using LAC 34440 14:02:42.414621 tst mo_mt_call_osmux.py: using RAC 15 14:02:42.538433 tst mo_mt_call_osmux.py: using CellId 34440 14:02:42.663813 tst mo_mt_call_osmux.py: using BVCI 34441 14:02:42.781203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.792733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.804229 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.815710 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.827583 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:02:42.839379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:02:42.957301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:02:43.079267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:43.578982 run create_hlr_db(pid=29333): Launched 14:02:43.703949 bus /sierra_2: Setting Powered False 14:02:44.768236 run create_hlr_db(pid=29333): Terminated: ok {rc=0} 14:02:45.199991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29335): Launched 14:02:45.503575 run osmo-hlr_10.42.42.2(pid=29336): Launched 14:02:45.622006 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:46.177763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29338): Launched 14:02:46.520864 run osmo-stp_10.42.42.5(pid=29339): Launched 14:02:46.716114 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:47.489059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29341): Launched 14:02:47.812270 run osmo-msc_10.42.42.6(pid=29342): Launched 14:02:47.991871 run osmo-stp_10.42.42.5(pid=29339): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29339)] 14:02:48.128302 run osmo-stp_10.42.42.5(pid=29339): stdout: | (launched: 2022-12-13_14:02:46.459263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:48.265250 run osmo-stp_10.42.42.5(pid=29339): stderr: | 20221213140246796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140246798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140246799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140246800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140246803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140246804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140246805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:48.400440 run osmo-stp_10.42.42.5(pid=29339): stdout: | (launched: 2022-12-13_14:02:46.459263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:48.528194 run osmo-stp_10.42.42.5(pid=29339): stderr: | 20221213140246796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140246798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140246799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140246800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140246803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140246804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140246805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:48.681197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29339): Process ended prematurely: osmo-stp_10.42.42.5(pid=29339) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29339)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:02:48.691062 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 14:02:48.718903 run osmo-hlr_10.42.42.2(pid=29336): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29336)] 14:02:48.769437 run osmo-hlr_10.42.42.2(pid=29336): stdout: | (launched: 2022-12-13_14:02:45.448052) 14:02:48.821271 run osmo-hlr_10.42.42.2(pid=29336): stderr: | 20221213140245622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140245622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140245622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140245622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140245622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140245622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140245633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140245641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140245642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140245642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:48.893315 run osmo-msc_10.42.42.6(pid=29342): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29342)] 14:02:48.943264 run osmo-msc_10.42.42.6(pid=29342): stdout: | (launched: 2022-12-13_14:02:47.752842) 14:02:48.994732 run osmo-msc_10.42.42.6(pid=29342): stderr: | 20221213140248070 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140248071 DLGLOBAL DEBUG validating counter group 0x7fe8b68b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140248071 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140248071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140248071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140248071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140248073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140248073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140248073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140248073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:49.047508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29335): Terminating (SIGTERM) 14:02:49.089249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29338): Terminating (SIGTERM) 14:02:49.131719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29341): Terminating (SIGTERM) 14:02:49.173922 --- ParallelTerminationStrategy: PID 29335 died... 14:02:49.194381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29335): Terminated: ok {rc=0} 14:02:49.240614 --- ParallelTerminationStrategy: PID 29338 died... 14:02:49.260424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29338): Terminated: ok {rc=0} 14:02:49.306645 --- ParallelTerminationStrategy: PID 29341 died... 14:02:49.326634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29341): Terminated: ok {rc=0} 14:02:49.414528 bus /sierra_3: Setting Powered False 14:02:50.509981 bus /sierra_3: Setting Powered False 14:02:51.620633 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:02:52.868423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:52.878150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:02:52.903178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:02:52.931825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:02:52.988277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:02:53.013585 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:02:53.041089 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:02:53.591514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:02:53.643992 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:53.655963 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:02:53.714672 tst mo_mt_call.py: using LAC 34441 14:02:53.840656 tst mo_mt_call.py: using RAC 16 14:02:53.966097 tst mo_mt_call.py: using CellId 34441 14:02:54.093442 tst mo_mt_call.py: using BVCI 34442 14:02:54.203953 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:54.215318 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:54.226500 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:54.237630 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:54.248708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:02:54.259836 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:02:54.373279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:02:54.492207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:54.991683 run create_hlr_db(pid=29347): Launched 14:02:55.116114 bus /sierra_2: Setting Powered False 14:02:56.178778 run create_hlr_db(pid=29347): Terminated: ok {rc=0} 14:02:56.627677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Launched 14:02:56.951763 run osmo-hlr_10.42.42.2(pid=29350): Launched 14:02:57.074589 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:57.632040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Launched 14:02:57.954473 run osmo-stp_10.42.42.5(pid=29353): Launched 14:02:58.078932 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:58.660585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29355): Launched 14:02:58.984642 run osmo-msc_10.42.42.6(pid=29356): Launched 14:02:59.164837 run osmo-stp_10.42.42.5(pid=29353): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] 14:02:59.305805 run osmo-stp_10.42.42.5(pid=29353): stdout: | (launched: 2022-12-13_14:02:57.895242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:59.443636 run osmo-stp_10.42.42.5(pid=29353): stderr: | 20221213140258082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140258082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140258083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140258083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140258083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140258083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140258084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:59.579501 run osmo-stp_10.42.42.5(pid=29353): stdout: | (launched: 2022-12-13_14:02:57.895242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:59.707758 run osmo-stp_10.42.42.5(pid=29353): stderr: | 20221213140258082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140258082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140258083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140258083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140258083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140258083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140258084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:59.861452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29353): Process ended prematurely: osmo-stp_10.42.42.5(pid=29353) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:02:59.870916 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:02:59.898512 run osmo-hlr_10.42.42.2(pid=29350): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29350)] 14:02:59.949102 run osmo-hlr_10.42.42.2(pid=29350): stdout: | (launched: 2022-12-13_14:02:56.891853) 14:03:00.001187 run osmo-hlr_10.42.42.2(pid=29350): stderr: | 20221213140257084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140257084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140257084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140257085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140257085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140257085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140257097 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140257105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140257106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140257106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:00.073435 run osmo-msc_10.42.42.6(pid=29356): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29356)] 14:03:00.122975 run osmo-msc_10.42.42.6(pid=29356): stdout: | (launched: 2022-12-13_14:02:58.925240) 14:03:00.174882 run osmo-msc_10.42.42.6(pid=29356): stderr: | 20221213140259242 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140259242 DLGLOBAL DEBUG validating counter group 0x7fba42c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140259242 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140259242 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140259242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140259243 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140259244 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140259245 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140259245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140259245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:00.227499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Terminating (SIGTERM) 14:03:00.269025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Terminating (SIGTERM) 14:03:00.311464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29355): Terminating (SIGTERM) 14:03:00.353699 --- ParallelTerminationStrategy: PID 29349 died... 14:03:00.374085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Terminated: ok {rc=0} 14:03:00.420269 --- ParallelTerminationStrategy: PID 29352 died... 14:03:00.440035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Terminated: ok {rc=0} 14:03:00.486077 --- ParallelTerminationStrategy: PID 29355 died... 14:03:00.505866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29355): Terminated: ok {rc=0} 14:03:00.593660 bus /sierra_3: Setting Powered False 14:03:01.711370 bus /sierra_3: Setting Powered False 14:03:02.845159 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:03:03.990162 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.002087 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:03:04.061422 tst mo_mt_call_osmux.py: using LAC 34442 14:03:04.185061 tst mo_mt_call_osmux.py: using RAC 17 14:03:04.301836 tst mo_mt_call_osmux.py: using CellId 34442 14:03:04.419116 tst mo_mt_call_osmux.py: using BVCI 34443 14:03:04.529580 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.540628 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.551816 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.562832 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.573820 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:03:04.584676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:03:04.704911 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:03:04.823824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:05.291244 run create_hlr_db(pid=29359): Launched 14:03:05.417321 bus /sierra_2: Setting Powered False 14:03:06.476622 run create_hlr_db(pid=29359): Terminated: ok {rc=0} 14:03:06.896661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Launched 14:03:07.198867 run osmo-hlr_10.42.42.2(pid=29362): Launched 14:03:07.313792 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:07.843419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Launched 14:03:08.143388 run osmo-stp_10.42.42.5(pid=29365): Launched 14:03:08.256345 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:08.799171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Launched 14:03:09.101802 run osmo-msc_10.42.42.6(pid=29368): Launched 14:03:09.269755 run osmo-stp_10.42.42.5(pid=29365): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] 14:03:09.396764 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-13_14:03:08.087768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:09.524923 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221213140308254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140308255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140308255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140308255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140308256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140308256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140308256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:09.650797 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-13_14:03:08.087768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:09.769876 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221213140308254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140308255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140308255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140308255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140308256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140308256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140308256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:09.912791 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:03:09.921946 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 14:03:09.948274 run osmo-hlr_10.42.42.2(pid=29362): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29362)] 14:03:09.995827 run osmo-hlr_10.42.42.2(pid=29362): stdout: | (launched: 2022-12-13_14:03:07.143022) 14:03:10.044739 run osmo-hlr_10.42.42.2(pid=29362): stderr: | 20221213140307315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140307315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140307315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140307315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140307315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140307316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140307327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140307336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140307337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140307337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:10.113134 run osmo-msc_10.42.42.6(pid=29368): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29368)] 14:03:10.160031 run osmo-msc_10.42.42.6(pid=29368): stdout: | (launched: 2022-12-13_14:03:09.045233) 14:03:10.208526 run osmo-msc_10.42.42.6(pid=29368): stderr: | 20221213140309315 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140309315 DLGLOBAL DEBUG validating counter group 0x7f903a00cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140309315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140309316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140309316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140309316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140309318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140309318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140309318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140309318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:10.257820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminating (SIGTERM) 14:03:10.297035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminating (SIGTERM) 14:03:10.335883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminating (SIGTERM) 14:03:10.375255 --- ParallelTerminationStrategy: PID 29361 died... 14:03:10.394282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminated: ok {rc=0} 14:03:10.437892 --- ParallelTerminationStrategy: PID 29364 died... 14:03:10.456291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminated: ok {rc=0} 14:03:10.499834 --- ParallelTerminationStrategy: PID 29367 died... 14:03:10.518538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminated: ok {rc=0} 14:03:10.602490 bus /sierra_3: Setting Powered False 14:03:11.699760 bus /sierra_3: Setting Powered False 14:03:12.811945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:03:14.058044 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:14.066611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:03:14.090320 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:03:14.116921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:03:14.170236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:03:14.195048 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:03:14.222706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:03:14.771057 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:03:14.819790 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:14.831265 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:03:14.890363 tst mo_mt_call.py: using LAC 34443 14:03:15.009497 tst mo_mt_call.py: using RAC 18 14:03:15.140201 tst mo_mt_call.py: using CellId 34443 14:03:15.261367 tst mo_mt_call.py: using BVCI 34444 14:03:15.372302 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:15.383557 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:15.394682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:15.405925 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:15.417254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:15.428255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:03:15.547962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:03:15.667929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:16.163143 run create_hlr_db(pid=29373): Launched 14:03:16.323276 bus /sierra_2: Setting Powered False 14:03:17.383353 run create_hlr_db(pid=29373): Terminated: ok {rc=0} 14:03:17.822672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Launched 14:03:18.145641 run osmo-hlr_10.42.42.2(pid=29376): Launched 14:03:18.270475 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:18.828280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Launched 14:03:19.153743 run osmo-stp_10.42.42.5(pid=29379): Launched 14:03:19.275882 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:19.857586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Launched 14:03:20.182056 run osmo-msc_10.42.42.6(pid=29382): Launched 14:03:20.362938 run osmo-stp_10.42.42.5(pid=29379): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] 14:03:20.499712 run osmo-stp_10.42.42.5(pid=29379): stdout: | (launched: 2022-12-13_14:03:19.094143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:20.635738 run osmo-stp_10.42.42.5(pid=29379): stderr: | 20221213140319282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140319283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140319283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140319283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140319284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140319284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140319284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:20.771250 run osmo-stp_10.42.42.5(pid=29379): stdout: | (launched: 2022-12-13_14:03:19.094143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:20.899165 run osmo-stp_10.42.42.5(pid=29379): stderr: | 20221213140319282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140319283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140319283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140319283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140319284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140319284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140319284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:21.053210 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29379): Process ended prematurely: osmo-stp_10.42.42.5(pid=29379) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:03:21.062972 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:03:21.090783 run osmo-hlr_10.42.42.2(pid=29376): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29376)] 14:03:21.141549 run osmo-hlr_10.42.42.2(pid=29376): stdout: | (launched: 2022-12-13_14:03:18.086711) 14:03:21.193217 run osmo-hlr_10.42.42.2(pid=29376): stderr: | 20221213140318281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140318281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140318281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140318281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140318281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140318281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140318295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140318305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140318305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140318305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:21.265451 run osmo-msc_10.42.42.6(pid=29382): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29382)] 14:03:21.315300 run osmo-msc_10.42.42.6(pid=29382): stdout: | (launched: 2022-12-13_14:03:20.122647) 14:03:21.367100 run osmo-msc_10.42.42.6(pid=29382): stderr: | 20221213140320441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140320441 DLGLOBAL DEBUG validating counter group 0x7fbd5ae2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140320441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140320441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140320442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140320442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140320443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140320444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140320444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140320444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:21.418950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Terminating (SIGTERM) 14:03:21.460343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Terminating (SIGTERM) 14:03:21.502360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Terminating (SIGTERM) 14:03:21.545153 --- ParallelTerminationStrategy: PID 29375 died... 14:03:21.565489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Terminated: ok {rc=0} 14:03:21.611773 --- ParallelTerminationStrategy: PID 29378 died... 14:03:21.631469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Terminated: ok {rc=0} 14:03:21.677825 --- ParallelTerminationStrategy: PID 29381 died... 14:03:21.697587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Terminated: ok {rc=0} 14:03:21.784680 bus /sierra_3: Setting Powered False 14:03:22.882941 bus /sierra_3: Setting Powered False 14:03:23.997539 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:03:25.143539 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.155490 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:03:25.215542 tst mo_mt_call_osmux.py: using LAC 34444 14:03:25.333438 tst mo_mt_call_osmux.py: using RAC 19 14:03:25.452579 tst mo_mt_call_osmux.py: using CellId 34444 14:03:25.573068 tst mo_mt_call_osmux.py: using BVCI 34445 14:03:25.683021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.694284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.705273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.716239 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.727303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:03:25.738295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:03:25.853707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:03:25.975919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:26.476904 run create_hlr_db(pid=29384): Launched 14:03:26.602073 bus /sierra_2: Setting Powered False 14:03:27.665035 run create_hlr_db(pid=29384): Terminated: ok {rc=0} 14:03:28.093900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29386): Launched 14:03:28.397515 run osmo-hlr_10.42.42.2(pid=29387): Launched 14:03:28.527025 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:29.085668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29389): Launched 14:03:29.409393 run osmo-stp_10.42.42.5(pid=29390): Launched 14:03:29.531589 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:30.121577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29392): Launched 14:03:30.446675 run osmo-msc_10.42.42.6(pid=29393): Launched 14:03:30.628097 run osmo-stp_10.42.42.5(pid=29390): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29390)] 14:03:30.766434 run osmo-stp_10.42.42.5(pid=29390): stdout: | (launched: 2022-12-13_14:03:29.349565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:30.963628 run osmo-stp_10.42.42.5(pid=29390): stderr: | 20221213140329536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140329536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140329536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140329537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140329537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140329537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140329538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:31.102939 run osmo-stp_10.42.42.5(pid=29390): stdout: | (launched: 2022-12-13_14:03:29.349565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:31.228222 run osmo-stp_10.42.42.5(pid=29390): stderr: | 20221213140329536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140329536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140329536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140329537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140329537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140329537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140329538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:31.376784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29390): Process ended prematurely: osmo-stp_10.42.42.5(pid=29390) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29390)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:03:31.386543 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:03:31.414193 run osmo-hlr_10.42.42.2(pid=29387): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29387)] 14:03:31.463356 run osmo-hlr_10.42.42.2(pid=29387): stdout: | (launched: 2022-12-13_14:03:28.338848) 14:03:31.513915 run osmo-hlr_10.42.42.2(pid=29387): stderr: | 20221213140328535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140328535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140328535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140328535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140328535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140328535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140328548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140328556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140328556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140328557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:31.585986 run osmo-msc_10.42.42.6(pid=29393): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29393)] 14:03:31.635804 run osmo-msc_10.42.42.6(pid=29393): stdout: | (launched: 2022-12-13_14:03:30.387101) 14:03:31.687407 run osmo-msc_10.42.42.6(pid=29393): stderr: | 20221213140330707 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140330707 DLGLOBAL DEBUG validating counter group 0x7f991ed72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140330707 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140330707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140330707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140330707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140330709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140330709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140330710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140330710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:31.737891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29386): Terminating (SIGTERM) 14:03:31.780364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29389): Terminating (SIGTERM) 14:03:31.824334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29392): Terminating (SIGTERM) 14:03:31.868105 --- ParallelTerminationStrategy: PID 29386 died... 14:03:31.896820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29386): Terminated: ok {rc=0} 14:03:31.958156 --- ParallelTerminationStrategy: PID 29389 died... 14:03:31.983044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29389): Terminated: ok {rc=0} 14:03:32.040345 --- ParallelTerminationStrategy: PID 29392 died... 14:03:32.059669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29392): Terminated: ok {rc=0} 14:03:32.149483 bus /sierra_3: Setting Powered False 14:03:33.257481 bus /sierra_3: Setting Powered False 14:03:34.368164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:03:35.611350 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:35.619370 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:03:35.644192 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:03:35.672609 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:03:35.727284 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:03:35.751061 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:03:35.777680 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:03:36.331684 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:03:36.384122 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.395958 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:03:36.457231 tst mo_mt_call.py: using LAC 34445 14:03:36.585135 tst mo_mt_call.py: using RAC 20 14:03:36.711342 tst mo_mt_call.py: using CellId 34445 14:03:36.829856 tst mo_mt_call.py: using BVCI 34446 14:03:36.938778 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.950263 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.961443 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.972647 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.983900 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:36.995063 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:03:37.113943 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:03:37.234314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:37.734440 run create_hlr_db(pid=29399): Launched 14:03:37.860289 bus /sierra_2: Setting Powered False 14:03:38.920304 run create_hlr_db(pid=29399): Terminated: ok {rc=0} 14:03:39.368816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Launched 14:03:39.692566 run osmo-hlr_10.42.42.2(pid=29402): Launched 14:03:39.814440 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:40.371647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Launched 14:03:40.677851 run osmo-stp_10.42.42.5(pid=29405): Launched 14:03:40.791465 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:41.334451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Launched 14:03:41.635532 run osmo-msc_10.42.42.6(pid=29408): Launched 14:03:41.803515 run osmo-stp_10.42.42.5(pid=29405): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] 14:03:41.930564 run osmo-stp_10.42.42.5(pid=29405): stdout: | (launched: 2022-12-13_14:03:40.622324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:42.057586 run osmo-stp_10.42.42.5(pid=29405): stderr: | 20221213140340790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140340790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140340791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140340791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140340791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140340792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140340792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:42.183498 run osmo-stp_10.42.42.5(pid=29405): stdout: | (launched: 2022-12-13_14:03:40.622324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:42.302750 run osmo-stp_10.42.42.5(pid=29405): stderr: | 20221213140340790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140340790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140340791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140340791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140340791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140340792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140340792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:42.445832 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29405): Process ended prematurely: osmo-stp_10.42.42.5(pid=29405) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:03:42.454888 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:03:42.481293 run osmo-hlr_10.42.42.2(pid=29402): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29402)] 14:03:42.529141 run osmo-hlr_10.42.42.2(pid=29402): stdout: | (launched: 2022-12-13_14:03:39.632752) 14:03:42.578529 run osmo-hlr_10.42.42.2(pid=29402): stderr: | 20221213140339827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140339827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140339827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140339828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140339828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140339828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140339840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140339848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140339848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140339848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:42.647132 run osmo-msc_10.42.42.6(pid=29408): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29408)] 14:03:42.694227 run osmo-msc_10.42.42.6(pid=29408): stdout: | (launched: 2022-12-13_14:03:41.579485) 14:03:42.742697 run osmo-msc_10.42.42.6(pid=29408): stderr: | 20221213140341851 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140341851 DLGLOBAL DEBUG validating counter group 0x7f13c9acbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140341851 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140341851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140341851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140341851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140341853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140341853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140341854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140341854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:42.791829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Terminating (SIGTERM) 14:03:42.831313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Terminating (SIGTERM) 14:03:42.870849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Terminating (SIGTERM) 14:03:42.911015 --- ParallelTerminationStrategy: PID 29401 died... 14:03:42.930360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Terminated: ok {rc=0} 14:03:42.974383 --- ParallelTerminationStrategy: PID 29404 died... 14:03:42.993159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Terminated: ok {rc=0} 14:03:43.036909 --- ParallelTerminationStrategy: PID 29407 died... 14:03:43.056198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Terminated: ok {rc=0} 14:03:43.139202 bus /sierra_3: Setting Powered False 14:03:44.234058 bus /sierra_3: Setting Powered False 14:03:45.349140 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:03:46.497197 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:46.509668 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:03:46.569221 tst mo_mt_call_osmux.py: using LAC 34446 14:03:46.734565 tst mo_mt_call_osmux.py: using RAC 21 14:03:46.863829 tst mo_mt_call_osmux.py: using CellId 34446 14:03:47.002858 tst mo_mt_call_osmux.py: using BVCI 34447 14:03:47.164631 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:47.180572 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:47.195464 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:47.210140 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:47.226412 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:03:47.240872 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:03:47.364767 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:03:47.484281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:47.985642 run create_hlr_db(pid=29410): Launched 14:03:48.110941 bus /sierra_2: Setting Powered False 14:03:49.174248 run create_hlr_db(pid=29410): Terminated: ok {rc=0} 14:03:49.621468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29412): Launched 14:03:49.946340 run osmo-hlr_10.42.42.2(pid=29413): Launched 14:03:50.070666 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:50.625212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29415): Launched 14:03:50.946872 run osmo-stp_10.42.42.5(pid=29416): Launched 14:03:51.070696 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:51.652262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29418): Launched 14:03:51.977615 run osmo-msc_10.42.42.6(pid=29419): Launched 14:03:52.157851 run osmo-stp_10.42.42.5(pid=29416): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29416)] 14:03:52.294647 run osmo-stp_10.42.42.5(pid=29416): stdout: | (launched: 2022-12-13_14:03:50.887925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:52.432524 run osmo-stp_10.42.42.5(pid=29416): stderr: | 20221213140351075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140351075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140351076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140351076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140351077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140351077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140351077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:52.568477 run osmo-stp_10.42.42.5(pid=29416): stdout: | (launched: 2022-12-13_14:03:50.887925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:52.697096 run osmo-stp_10.42.42.5(pid=29416): stderr: | 20221213140351075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140351075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140351076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140351076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140351077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140351077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140351077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:52.851439 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29416): Process ended prematurely: osmo-stp_10.42.42.5(pid=29416) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29416)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:03:52.861305 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:03:52.889180 run osmo-hlr_10.42.42.2(pid=29413): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29413)] 14:03:52.940226 run osmo-hlr_10.42.42.2(pid=29413): stdout: | (launched: 2022-12-13_14:03:49.887182) 14:03:52.992595 run osmo-hlr_10.42.42.2(pid=29413): stderr: | 20221213140350082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140350082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140350082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140350082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140350083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140350083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140350096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140350104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140350104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140350104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:53.065192 run osmo-msc_10.42.42.6(pid=29419): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29419)] 14:03:53.115299 run osmo-msc_10.42.42.6(pid=29419): stdout: | (launched: 2022-12-13_14:03:51.917636) 14:03:53.166937 run osmo-msc_10.42.42.6(pid=29419): stderr: | 20221213140352235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140352235 DLGLOBAL DEBUG validating counter group 0x7fe39c5b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140352235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140352235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140352235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140352235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140352237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140352238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140352238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140352238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:53.219094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29412): Terminating (SIGTERM) 14:03:53.260451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29415): Terminating (SIGTERM) 14:03:53.302755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29418): Terminating (SIGTERM) 14:03:53.344925 --- ParallelTerminationStrategy: PID 29412 died... 14:03:53.365438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29412): Terminated: ok {rc=0} 14:03:53.411920 --- ParallelTerminationStrategy: PID 29415 died... 14:03:53.431831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29415): Terminated: ok {rc=0} 14:03:53.478018 --- ParallelTerminationStrategy: PID 29418 died... 14:03:53.497923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29418): Terminated: ok {rc=0} 14:03:53.585070 bus /sierra_3: Setting Powered False 14:03:54.682116 bus /sierra_3: Setting Powered False 14:03:55.796722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:03:57.039916 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:57.048104 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:03:57.072840 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:03:57.101306 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:03:57.155663 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:03:57.179533 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:03:57.206380 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:03:57.760577 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:03:57.813034 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:57.825025 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:03:57.887242 tst mo_mt_call.py: using LAC 34447 14:03:58.014356 tst mo_mt_call.py: using RAC 22 14:03:58.139875 tst mo_mt_call.py: using CellId 34447 14:03:58.266260 tst mo_mt_call.py: using BVCI 34448 14:03:58.385365 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:58.397259 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:58.409046 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:58.420659 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:58.432777 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:03:58.444917 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:03:58.562092 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:03:58.681540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:59.147303 run create_hlr_db(pid=29424): Launched 14:03:59.271132 bus /sierra_2: Setting Powered False 14:04:00.330876 run create_hlr_db(pid=29424): Terminated: ok {rc=0} 14:04:00.771474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29426): Launched 14:04:01.128364 run osmo-hlr_10.42.42.2(pid=29427): Launched 14:04:01.314568 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:01.973503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29429): Launched 14:04:02.316090 run osmo-stp_10.42.42.5(pid=29430): Launched 14:04:02.439257 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:03.024810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29432): Launched 14:04:03.348293 run osmo-msc_10.42.42.6(pid=29433): Launched 14:04:03.527385 run osmo-stp_10.42.42.5(pid=29430): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29430)] 14:04:03.662885 run osmo-stp_10.42.42.5(pid=29430): stdout: | (launched: 2022-12-13_14:04:02.255333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:03.799655 run osmo-stp_10.42.42.5(pid=29430): stderr: | 20221213140402443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140402443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140402443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140402443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140402444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140402444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140402444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:03.935187 run osmo-stp_10.42.42.5(pid=29430): stdout: | (launched: 2022-12-13_14:04:02.255333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:04.063680 run osmo-stp_10.42.42.5(pid=29430): stderr: | 20221213140402443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140402443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140402443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140402443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140402444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140402444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140402444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:04.216847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29430): Process ended prematurely: osmo-stp_10.42.42.5(pid=29430) [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29430)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:04:04.226595 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 14:04:04.254367 run osmo-hlr_10.42.42.2(pid=29427): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29427)] 14:04:04.305066 run osmo-hlr_10.42.42.2(pid=29427): stdout: | (launched: 2022-12-13_14:04:01.069111) 14:04:04.357426 run osmo-hlr_10.42.42.2(pid=29427): stderr: | 20221213140401437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140401437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140401437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140401437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140401437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140401437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140401463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140401477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140401477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140401478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:04.430136 run osmo-msc_10.42.42.6(pid=29433): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29433)] 14:04:04.480505 run osmo-msc_10.42.42.6(pid=29433): stdout: | (launched: 2022-12-13_14:04:03.289522) 14:04:04.532560 run osmo-msc_10.42.42.6(pid=29433): stderr: | 20221213140403607 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140403607 DLGLOBAL DEBUG validating counter group 0x7f14a0344c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140403607 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140403607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140403607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140403608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140403609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140403610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140403610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140403610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:04.584942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29426): Terminating (SIGTERM) 14:04:04.626651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29429): Terminating (SIGTERM) 14:04:04.668529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29432): Terminating (SIGTERM) 14:04:04.711036 --- ParallelTerminationStrategy: PID 29426 died... 14:04:04.731367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29426): Terminated: ok {rc=0} 14:04:04.777704 --- ParallelTerminationStrategy: PID 29429 died... 14:04:04.797414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29429): Terminated: ok {rc=0} 14:04:04.843419 --- ParallelTerminationStrategy: PID 29432 died... 14:04:04.863177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29432): Terminated: ok {rc=0} 14:04:04.950309 bus /sierra_3: Setting Powered False 14:04:06.049153 bus /sierra_3: Setting Powered False 14:04:07.164856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:04:08.314044 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.326361 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:04:08.389127 tst mo_mt_call_osmux.py: using LAC 34448 14:04:08.517076 tst mo_mt_call_osmux.py: using RAC 23 14:04:08.642343 tst mo_mt_call_osmux.py: using CellId 34448 14:04:08.768617 tst mo_mt_call_osmux.py: using BVCI 34449 14:04:08.887142 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.898881 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.910439 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.922024 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.934028 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:04:08.945996 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:04:09.064731 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:04:09.181098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:09.651401 run create_hlr_db(pid=29436): Launched 14:04:09.775694 bus /sierra_2: Setting Powered False 14:04:10.838744 run create_hlr_db(pid=29436): Terminated: ok {rc=0} 14:04:11.286665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Launched 14:04:11.610323 run osmo-hlr_10.42.42.2(pid=29439): Launched 14:04:11.734086 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:12.294034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Launched 14:04:12.617548 run osmo-stp_10.42.42.5(pid=29442): Launched 14:04:12.740366 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:13.328021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29444): Launched 14:04:13.652719 run osmo-msc_10.42.42.6(pid=29445): Launched 14:04:13.832892 run osmo-stp_10.42.42.5(pid=29442): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] 14:04:13.970090 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-13_14:04:12.558242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:14.107231 run osmo-stp_10.42.42.5(pid=29442): stderr: | 20221213140412747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140412747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140412747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140412747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140412748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140412748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140412748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:14.242455 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-13_14:04:12.558242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:14.370711 run osmo-stp_10.42.42.5(pid=29442): stderr: | 20221213140412747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140412747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140412747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140412747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140412748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140412748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140412748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:14.523949 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:04:14.533416 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:04:14.561323 run osmo-hlr_10.42.42.2(pid=29439): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29439)] 14:04:14.611240 run osmo-hlr_10.42.42.2(pid=29439): stdout: | (launched: 2022-12-13_14:04:11.551142) 14:04:14.662739 run osmo-hlr_10.42.42.2(pid=29439): stderr: | 20221213140411747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140411747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140411747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140411747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140411747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140411747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140411761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140411770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140411771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140411771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:14.734410 run osmo-msc_10.42.42.6(pid=29445): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29445)] 14:04:14.783556 run osmo-msc_10.42.42.6(pid=29445): stdout: | (launched: 2022-12-13_14:04:13.592427) 14:04:14.835363 run osmo-msc_10.42.42.6(pid=29445): stderr: | 20221213140413910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140413910 DLGLOBAL DEBUG validating counter group 0x7f3228588c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140413910 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140413910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140413910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140413911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140413912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140413913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140413913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140413913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:14.887059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminating (SIGTERM) 14:04:14.928267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminating (SIGTERM) 14:04:14.970415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29444): Terminating (SIGTERM) 14:04:15.012378 --- ParallelTerminationStrategy: PID 29438 died... 14:04:15.032607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminated: ok {rc=0} 14:04:15.078907 --- ParallelTerminationStrategy: PID 29441 died... 14:04:15.098625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminated: ok {rc=0} 14:04:15.144458 --- ParallelTerminationStrategy: PID 29444 died... 14:04:15.164142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29444): Terminated: ok {rc=0} 14:04:15.250902 bus /sierra_3: Setting Powered False 14:04:16.349725 bus /sierra_3: Setting Powered False 14:04:17.469214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:nanobts+band-1900 --------------------------------------------------------------------- 14:04:18.714785 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:18.720726 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 14:04:18.745235 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 14:04:18.773636 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 14:04:18.860708 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 14:04:18.885467 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 14:04:18.913271 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 14:04:19.499606 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 14:04:19.505075 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:19.516345 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:04:19.556154 tst emergency_mo_mt_call.py: using LAC 34449 14:04:19.684495 tst emergency_mo_mt_call.py: using RAC 24 14:04:19.801348 tst emergency_mo_mt_call.py: using CellId 34449 14:04:19.916735 tst emergency_mo_mt_call.py: using BVCI 34450 14:04:20.024783 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:20.035610 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:20.046463 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:20.057136 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:20.068281 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:20.079356 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:20.198877 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:20.315950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:20.808154 run create_hlr_db(pid=29450): Launched 14:04:20.930410 bus /sierra_2: Setting Powered False 14:04:21.989547 run create_hlr_db(pid=29450): Terminated: ok {rc=0} 14:04:22.413723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Launched 14:04:22.711386 run osmo-hlr_10.42.42.2(pid=29453): Launched 14:04:22.823006 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:23.347845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Launched 14:04:23.643528 run osmo-stp_10.42.42.5(pid=29456): Launched 14:04:23.766232 tst emergency_mo_mt_call.py: using MSISDN 8189 14:04:23.915318 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:24.447617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Launched 14:04:24.742524 run osmo-msc_10.42.42.6(pid=29459): Launched 14:04:24.906773 run osmo-stp_10.42.42.5(pid=29456): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] 14:04:25.030921 run osmo-stp_10.42.42.5(pid=29456): stdout: | (launched: 2022-12-13_14:04:23.587743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:25.155736 run osmo-stp_10.42.42.5(pid=29456): stderr: | 20221213140423755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140423755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140423755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140423756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140423756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140423756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140423756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:25.278248 run osmo-stp_10.42.42.5(pid=29456): stdout: | (launched: 2022-12-13_14:04:23.587743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:25.394535 run osmo-stp_10.42.42.5(pid=29456): stderr: | 20221213140423755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140423755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140423755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140423756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140423756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140423756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140423756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:25.534096 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29456): Process ended prematurely: osmo-stp_10.42.42.5(pid=29456) [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 14:04:25.542379 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 14:04:25.568132 run osmo-hlr_10.42.42.2(pid=29453): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29453)] 14:04:25.614946 run osmo-hlr_10.42.42.2(pid=29453): stdout: | (launched: 2022-12-13_14:04:22.656003) 14:04:25.663566 run osmo-hlr_10.42.42.2(pid=29453): stderr: | 20221213140422829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140422829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140422829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140422829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140422829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140422829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140422840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140422849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140422849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140422849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:25.731657 run osmo-msc_10.42.42.6(pid=29459): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29459)] 14:04:25.779050 run osmo-msc_10.42.42.6(pid=29459): stdout: | (launched: 2022-12-13_14:04:24.687457) 14:04:25.827407 run osmo-msc_10.42.42.6(pid=29459): stderr: | 20221213140424954 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140424954 DLGLOBAL DEBUG validating counter group 0x7f382b2c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140424954 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140424954 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140424955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140424955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140424957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140424957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140424957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140424957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:25.876650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Terminating (SIGTERM) 14:04:25.915711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Terminating (SIGTERM) 14:04:25.954922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Terminating (SIGTERM) 14:04:25.994274 --- ParallelTerminationStrategy: PID 29452 died... 14:04:26.012482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Terminated: ok {rc=0} 14:04:26.056059 --- ParallelTerminationStrategy: PID 29455 died... 14:04:26.074418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Terminated: ok {rc=0} 14:04:26.117494 --- ParallelTerminationStrategy: PID 29458 died... 14:04:26.135828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Terminated: ok {rc=0} 14:04:26.217786 bus /sierra_3: Setting Powered False 14:04:27.314896 bus /sierra_3: Setting Powered False 14:04:28.430254 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 14:04:29.515156 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:29.527387 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:04:29.573218 tst emergency_preemptive_call.py: using LAC 34450 14:04:29.699087 tst emergency_preemptive_call.py: using RAC 25 14:04:29.821218 tst emergency_preemptive_call.py: using CellId 34450 14:04:29.943069 tst emergency_preemptive_call.py: using BVCI 34451 14:04:30.060049 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:30.071623 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:30.082912 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:30.094132 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:30.105824 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 14:04:30.117502 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:30.234982 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:30.350136 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:30.469362 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:30.584872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:31.067182 run create_hlr_db(pid=29461): Launched 14:04:31.224448 bus /sierra_2: Setting Powered False 14:04:32.284415 run create_hlr_db(pid=29461): Terminated: ok {rc=0} 14:04:32.720380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29463): Launched 14:04:33.041901 run osmo-hlr_10.42.42.2(pid=29464): Launched 14:04:33.163645 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:33.714355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29466): Launched 14:04:34.033640 run osmo-stp_10.42.42.5(pid=29467): Launched 14:04:34.167860 tst emergency_preemptive_call.py: using MSISDN 8190 14:04:34.333705 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:34.904158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29469): Launched 14:04:35.224372 run osmo-msc_10.42.42.6(pid=29470): Launched 14:04:35.403131 run osmo-stp_10.42.42.5(pid=29467): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29467)] 14:04:35.537388 run osmo-stp_10.42.42.5(pid=29467): stdout: | (launched: 2022-12-13_14:04:33.974763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:35.672882 run osmo-stp_10.42.42.5(pid=29467): stderr: | 20221213140434164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140434164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140434164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140434165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140434165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140434165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140434165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:35.807345 run osmo-stp_10.42.42.5(pid=29467): stdout: | (launched: 2022-12-13_14:04:33.974763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:35.933877 run osmo-stp_10.42.42.5(pid=29467): stderr: | 20221213140434164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140434164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140434164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140434165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140434165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140434165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140434165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:36.085812 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29467): Process ended prematurely: osmo-stp_10.42.42.5(pid=29467) [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29467)] [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 14:04:36.095017 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 14:04:36.123069 run osmo-hlr_10.42.42.2(pid=29464): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29464)] 14:04:36.173767 run osmo-hlr_10.42.42.2(pid=29464): stdout: | (launched: 2022-12-13_14:04:32.983004) 14:04:36.225642 run osmo-hlr_10.42.42.2(pid=29464): stderr: | 20221213140433176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140433177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140433177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140433177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140433177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140433177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140433187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140433196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140433196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140433196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:36.297699 run osmo-msc_10.42.42.6(pid=29470): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29470)] 14:04:36.347199 run osmo-msc_10.42.42.6(pid=29470): stdout: | (launched: 2022-12-13_14:04:35.165259) 14:04:36.399232 run osmo-msc_10.42.42.6(pid=29470): stderr: | 20221213140435482 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140435482 DLGLOBAL DEBUG validating counter group 0x7fd3e028fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140435482 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140435482 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140435482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140435482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140435484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140435485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140435485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140435485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:36.451267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29463): Terminating (SIGTERM) 14:04:36.492810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29466): Terminating (SIGTERM) 14:04:36.534974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29469): Terminating (SIGTERM) 14:04:36.577280 --- ParallelTerminationStrategy: PID 29463 died... 14:04:36.597716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29463): Terminated: ok {rc=0} 14:04:36.644113 --- ParallelTerminationStrategy: PID 29466 died... 14:04:36.664170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29466): Terminated: ok {rc=0} 14:04:36.710358 --- ParallelTerminationStrategy: PID 29469 died... 14:04:36.730185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29469): Terminated: ok {rc=0} 14:04:36.818355 bus /sierra_9: Setting Powered False 14:04:37.917570 bus /sierra_9: Setting Powered False 14:04:39.033502 bus /sierra_8: Setting Powered False 14:04:40.130654 bus /sierra_8: Setting Powered False 14:04:41.249712 bus /sierra_3: Setting Powered False 14:04:42.347403 bus /sierra_3: Setting Powered False 14:04:43.459435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900 --------------------------------------------------------------------- 14:04:44.736309 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:44.742102 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 14:04:44.766267 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 14:04:44.806936 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 14:04:44.895169 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 14:04:44.918720 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 14:04:44.956910 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 14:04:45.549626 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 14:04:45.599405 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:45.610369 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:04:45.646742 tst cs_paging_gprs_active.py: using LAC 34451 14:04:45.764407 tst cs_paging_gprs_active.py: using RAC 26 14:04:45.886233 tst cs_paging_gprs_active.py: using CellId 34451 14:04:46.026835 tst cs_paging_gprs_active.py: using BVCI 34452 14:04:46.147555 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.159767 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.172887 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.184867 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.197965 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.210767 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.223717 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.236301 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:46.249340 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:46.374810 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:46.494341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:04:46.773056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:47.162064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29475): Launched 14:04:47.459974 run iperf3-srv_10.42.42.10(pid=29476): Launched 14:04:47.582243 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:04:47.800242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:48.126357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29477): Launched 14:04:48.411267 run iperf3-srv_10.42.42.10(pid=29478): Launched 14:04:48.535028 tst cs_paging_gprs_active.py:38: start network... 14:04:48.752910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:49.255719 run create_hlr_db(pid=29479): Launched 14:04:49.379788 bus /sierra_2: Setting Powered False 14:04:50.443260 run create_hlr_db(pid=29479): Terminated: ok {rc=0} 14:04:50.893930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Launched 14:04:51.219429 run osmo-hlr_10.42.42.2(pid=29482): Launched 14:04:51.343342 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:51.902518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Launched 14:04:52.228941 run osmo-stp_10.42.42.5(pid=29485): Launched 14:04:52.355551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:52.914799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Launched 14:04:53.041551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:53.315915 run patchelf(pid=29488): Launched 14:04:53.498313 run osmo-stp_10.42.42.5(pid=29485): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] 14:04:53.636252 run osmo-stp_10.42.42.5(pid=29485): stdout: | (launched: 2022-12-13_14:04:52.169493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:53.775471 run osmo-stp_10.42.42.5(pid=29485): stderr: | 20221213140452358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140452358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140452359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140452359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140452360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140452360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140452360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:53.915144 run osmo-stp_10.42.42.5(pid=29485): stdout: | (launched: 2022-12-13_14:04:52.169493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:54.048907 run osmo-stp_10.42.42.5(pid=29485): stderr: | 20221213140452358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140452358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140452359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140452359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140452360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140452360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140452360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:54.206285 run patchelf(pid=29488): Terminating (SIGINT) 14:04:54.389172 run patchelf(pid=29488): Terminated: ok {rc=0} 14:04:54.520463 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29485): Process ended prematurely: osmo-stp_10.42.42.5(pid=29485) [trial-2390↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] [trial-2390↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 14:04:54.531258 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 14:04:54.559580 run osmo-hlr_10.42.42.2(pid=29482): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29482)] 14:04:54.610133 run osmo-hlr_10.42.42.2(pid=29482): stdout: | (launched: 2022-12-13_14:04:51.159345) 14:04:54.662490 run osmo-hlr_10.42.42.2(pid=29482): stderr: | 20221213140451353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140451353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140451353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140451353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140451354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140451354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140451371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140451381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140451382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140451382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:54.714991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29475): Terminating (SIGTERM) 14:04:54.756683 run iperf3-srv_10.42.42.10(pid=29476): Terminating (SIGTERM) 14:04:54.798699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29477): Terminating (SIGTERM) 14:04:54.840884 run iperf3-srv_10.42.42.10(pid=29478): Terminating (SIGTERM) 14:04:54.883140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Terminating (SIGTERM) 14:04:54.925401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Terminating (SIGTERM) 14:04:54.967428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Terminating (SIGTERM) 14:04:55.009932 --- ParallelTerminationStrategy: PID 29475 died... 14:04:55.030500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29475): Terminated: ok {rc=0} 14:04:55.076908 --- ParallelTerminationStrategy: PID 29476 died... 14:04:55.096741 run iperf3-srv_10.42.42.10(pid=29476): Terminated {rc=256} 14:04:55.143222 --- ParallelTerminationStrategy: PID 29477 died... 14:04:55.162985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29477): Terminated: ok {rc=0} 14:04:55.209039 --- ParallelTerminationStrategy: PID 29478 died... 14:04:55.228771 run iperf3-srv_10.42.42.10(pid=29478): Terminated {rc=256} 14:04:55.274720 --- ParallelTerminationStrategy: PID 29481 died... 14:04:55.294574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Terminated: ok {rc=0} 14:04:55.340851 --- ParallelTerminationStrategy: PID 29484 died... 14:04:55.361315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Terminated: ok {rc=0} 14:04:55.407469 --- ParallelTerminationStrategy: PID 29487 died... 14:04:55.427419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Terminated: ok {rc=0} 14:04:55.515005 bus /gobi_0: Setting Powered False 14:04:56.613442 bus /gobi_0: Setting Powered False 14:04:57.728897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 14:04:58.877912 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:58.889780 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:04:58.929868 tst iperf3.py: using LAC 34452 14:04:59.056876 tst iperf3.py: using RAC 27 14:04:59.185200 tst iperf3.py: using CellId 34452 14:04:59.311112 tst iperf3.py: using BVCI 34453 14:04:59.428893 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.440412 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.451482 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.462456 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.473827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.484909 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.496401 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.507798 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:04:59.519214 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:04:59.639588 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:04:59.840079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:00.140806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29489): Launched 14:05:00.404778 run iperf3-srv_10.42.42.10(pid=29490): Launched 14:05:00.517872 tst iperf3.py:8: start network... 14:05:00.719289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:01.229891 run create_hlr_db(pid=29491): Launched 14:05:01.424435 bus /gobi_6: Setting Powered False 14:05:02.488823 run create_hlr_db(pid=29491): Terminated: ok {rc=0} 14:05:02.921967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Launched 14:05:03.249639 run osmo-hlr_10.42.42.2(pid=29497): Launched 14:05:03.372571 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:03.931008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Launched 14:05:04.255311 run osmo-stp_10.42.42.5(pid=29500): Launched 14:05:04.378547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:04.935532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Launched 14:05:05.061620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:05.336310 run patchelf(pid=29503): Launched 14:05:05.515691 run osmo-stp_10.42.42.5(pid=29500): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] 14:05:05.653318 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-13_14:05:04.195372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:05.791934 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221213140504385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140504385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140504385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140504386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140504386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140504386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140504386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:05.930737 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-13_14:05:04.195372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:06.063858 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221213140504385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140504385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140504385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140504386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140504386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140504386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140504386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:06.220548 run patchelf(pid=29503): Terminating (SIGINT) 14:05:06.403668 run patchelf(pid=29503): Terminated: ok {rc=0} 14:05:06.534928 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2390↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] [trial-2390↪gprs:nanobts+band-1900↪iperf3.py:8] 14:05:06.545202 tst iperf3.py:8: Test FAILED (7.7 sec) 14:05:06.573577 run osmo-hlr_10.42.42.2(pid=29497): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29497)] 14:05:06.624514 run osmo-hlr_10.42.42.2(pid=29497): stdout: | (launched: 2022-12-13_14:05:03.189427) 14:05:06.676714 run osmo-hlr_10.42.42.2(pid=29497): stderr: | 20221213140503384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140503384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140503384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140503384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140503384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140503384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140503397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140503405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140503406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140503406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:06.729335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29489): Terminating (SIGTERM) 14:05:06.771141 run iperf3-srv_10.42.42.10(pid=29490): Terminating (SIGTERM) 14:05:06.813357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminating (SIGTERM) 14:05:06.855578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminating (SIGTERM) 14:05:06.897733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminating (SIGTERM) 14:05:06.940169 --- ParallelTerminationStrategy: PID 29489 died... 14:05:06.960552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29489): Terminated: ok {rc=0} 14:05:07.007563 --- ParallelTerminationStrategy: PID 29490 died... 14:05:07.027593 run iperf3-srv_10.42.42.10(pid=29490): Terminated {rc=256} 14:05:07.073758 --- ParallelTerminationStrategy: PID 29496 died... 14:05:07.093340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminated: ok {rc=0} 14:05:07.139991 --- ParallelTerminationStrategy: PID 29499 died... 14:05:07.159987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminated: ok {rc=0} 14:05:07.206354 --- ParallelTerminationStrategy: PID 29502 died... 14:05:07.226376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminated: ok {rc=0} 14:05:07.313786 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 14:05:08.459102 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:08.470490 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:05:08.509057 tst iperf3m4.py: using LAC 34453 14:05:08.628737 tst iperf3m4.py: using RAC 28 14:05:08.748509 tst iperf3m4.py: using CellId 34453 14:05:08.877287 tst iperf3m4.py: using BVCI 34454 14:05:08.995149 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.006568 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.017827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.029116 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.040815 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.052459 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.064334 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.075894 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:09.087311 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:09.204465 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:09.327681 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:09.445686 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:09.563330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:05:09.766083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:10.069578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Launched 14:05:10.335528 run iperf3-srv_10.42.42.10(pid=29505): Launched 14:05:10.449961 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:05:10.650591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:10.953051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Launched 14:05:11.216428 run iperf3-srv_10.42.42.10(pid=29507): Launched 14:05:11.329903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:05:11.530807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:11.834235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Launched 14:05:12.098436 run iperf3-srv_10.42.42.10(pid=29509): Launched 14:05:12.213515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:05:12.413608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:12.716236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Launched 14:05:12.979198 run iperf3-srv_10.42.42.10(pid=29511): Launched 14:05:13.092404 tst iperf3m4.py:8: start network... 14:05:13.293513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:13.759387 run create_hlr_db(pid=29512): Launched 14:05:13.884351 bus /gobi_6: Setting Powered False 14:05:14.943519 run create_hlr_db(pid=29512): Terminated: ok {rc=0} 14:05:15.383754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Launched 14:05:15.709933 run osmo-hlr_10.42.42.2(pid=29515): Launched 14:05:15.854301 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:16.513093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Launched 14:05:16.843402 run osmo-stp_10.42.42.5(pid=29518): Launched 14:05:17.102257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:17.710873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Launched 14:05:17.826342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:18.082934 run patchelf(pid=29521): Launched 14:05:18.252805 run osmo-stp_10.42.42.5(pid=29518): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] 14:05:18.381224 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-13_14:05:16.781572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:18.511758 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221213140517076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140517076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140517076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140517076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140517077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140517077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140517077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:18.641991 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-13_14:05:16.781572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:18.766024 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221213140517076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140517076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140517076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140517076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140517077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140517077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140517077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:18.912824 run patchelf(pid=29521): Terminating (SIGINT) 14:05:19.083915 run patchelf(pid=29521): Terminated: ok {rc=0} 14:05:19.206563 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2390↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] [trial-2390↪gprs:nanobts+band-1900↪iperf3m4.py:8] 14:05:19.216069 tst iperf3m4.py:8: Test FAILED (10.8 sec) 14:05:19.243114 run osmo-hlr_10.42.42.2(pid=29515): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29515)] 14:05:19.290920 run osmo-hlr_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-13_14:05:15.649678) 14:05:19.340286 run osmo-hlr_10.42.42.2(pid=29515): stderr: | 20221213140515859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140515859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140515859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140515859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140515859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140515860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140515879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140515895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140515896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140515896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:19.390091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Terminating (SIGTERM) 14:05:19.430088 run iperf3-srv_10.42.42.10(pid=29505): Terminating (SIGTERM) 14:05:19.470017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Terminating (SIGTERM) 14:05:19.510085 run iperf3-srv_10.42.42.10(pid=29507): Terminating (SIGTERM) 14:05:19.549931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminating (SIGTERM) 14:05:19.590487 run iperf3-srv_10.42.42.10(pid=29509): Terminating (SIGTERM) 14:05:19.630465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Terminating (SIGTERM) 14:05:19.670501 run iperf3-srv_10.42.42.10(pid=29511): Terminating (SIGTERM) 14:05:19.710642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminating (SIGTERM) 14:05:19.750547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminating (SIGTERM) 14:05:19.790242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminating (SIGTERM) 14:05:19.830405 --- ParallelTerminationStrategy: PID 29504 died... 14:05:19.849892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Terminated: ok {rc=0} 14:05:19.894203 --- ParallelTerminationStrategy: PID 29505 died... 14:05:19.913264 run iperf3-srv_10.42.42.10(pid=29505): Terminated {rc=256} 14:05:19.957165 --- ParallelTerminationStrategy: PID 29506 died... 14:05:19.976289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Terminated: ok {rc=0} 14:05:20.020498 --- ParallelTerminationStrategy: PID 29507 died... 14:05:20.039478 run iperf3-srv_10.42.42.10(pid=29507): Terminated {rc=256} 14:05:20.083366 --- ParallelTerminationStrategy: PID 29508 died... 14:05:20.102339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminated: ok {rc=0} 14:05:20.146217 --- ParallelTerminationStrategy: PID 29509 died... 14:05:20.165249 run iperf3-srv_10.42.42.10(pid=29509): Terminated {rc=256} 14:05:20.209117 --- ParallelTerminationStrategy: PID 29510 died... 14:05:20.228154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Terminated: ok {rc=0} 14:05:20.272138 --- ParallelTerminationStrategy: PID 29511 died... 14:05:20.291210 run iperf3-srv_10.42.42.10(pid=29511): Terminated {rc=256} 14:05:20.335218 --- ParallelTerminationStrategy: PID 29514 died... 14:05:20.354311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminated: ok {rc=0} 14:05:20.398135 --- ParallelTerminationStrategy: PID 29517 died... 14:05:20.417277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminated: ok {rc=0} 14:05:20.461496 --- ParallelTerminationStrategy: PID 29520 died... 14:05:20.480741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminated: ok {rc=0} 14:05:20.566164 bus /gobi_4: Setting Powered False 14:05:21.667075 bus /gobi_4: Setting Powered False 14:05:22.786067 bus /gobi_1: Setting Powered False 14:05:23.886200 bus /gobi_1: Setting Powered False 14:05:25.004121 bus /gobi_0: Setting Powered False 14:05:26.103127 bus /gobi_0: Setting Powered False 14:05:27.217828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 14:05:28.319771 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.330984 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:05:28.369058 tst ping.py: using LAC 34454 14:05:28.485429 tst ping.py: using RAC 29 14:05:28.607208 tst ping.py: using CellId 34454 14:05:28.723464 tst ping.py: using BVCI 34455 14:05:28.830335 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.840887 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.851518 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.862094 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.872525 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.883032 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.893587 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:28.904141 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:29.017543 tst ping.py:19: start network... 14:05:29.213610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:29.669789 run create_hlr_db(pid=29522): Launched 14:05:29.791891 bus /gobi_6: Setting Powered False 14:05:30.867667 run create_hlr_db(pid=29522): Terminated: ok {rc=0} 14:05:31.302137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29524): Launched 14:05:31.689712 run osmo-hlr_10.42.42.2(pid=29525): Launched 14:05:31.920163 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:32.607382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29527): Launched 14:05:32.904831 run osmo-stp_10.42.42.5(pid=29528): Launched 14:05:33.017796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:33.531511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29530): Launched 14:05:33.645209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:33.895512 run patchelf(pid=29531): Launched 14:05:34.059765 run osmo-stp_10.42.42.5(pid=29528): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29528)] 14:05:34.184834 run osmo-stp_10.42.42.5(pid=29528): stdout: | (launched: 2022-12-13_14:05:32.849306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:34.311652 run osmo-stp_10.42.42.5(pid=29528): stderr: | 20221213140533017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140533017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140533017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140533017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140533018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140533018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140533018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:34.438605 run osmo-stp_10.42.42.5(pid=29528): stdout: | (launched: 2022-12-13_14:05:32.849306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:34.559580 run osmo-stp_10.42.42.5(pid=29528): stderr: | 20221213140533017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140533017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140533017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140533017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140533018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140533018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140533018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:34.703509 run patchelf(pid=29531): Terminating (SIGINT) 14:05:34.870192 run patchelf(pid=29531): Terminated: ok {rc=0} 14:05:34.989984 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29528): Process ended prematurely: osmo-stp_10.42.42.5(pid=29528) [trial-2390↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29528)] [trial-2390↪gprs:nanobts+band-1900↪ping.py:22] 14:05:34.998951 tst ping.py:22: Test FAILED (6.7 sec) 14:05:35.025446 run osmo-hlr_10.42.42.2(pid=29525): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29525)] 14:05:35.072434 run osmo-hlr_10.42.42.2(pid=29525): stdout: | (launched: 2022-12-13_14:05:31.633525) 14:05:35.121183 run osmo-hlr_10.42.42.2(pid=29525): stderr: | 20221213140531964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140531964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140531964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140531964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140531964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140531965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140531983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140531991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140531991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140531991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:35.169914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29524): Terminating (SIGTERM) 14:05:35.209168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29527): Terminating (SIGTERM) 14:05:35.248437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29530): Terminating (SIGTERM) 14:05:35.287999 --- ParallelTerminationStrategy: PID 29524 died... 14:05:35.307325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29524): Terminated: ok {rc=0} 14:05:35.351170 --- ParallelTerminationStrategy: PID 29527 died... 14:05:35.369767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29527): Terminated: ok {rc=0} 14:05:35.413712 --- ParallelTerminationStrategy: PID 29530 died... 14:05:35.432396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29530): Terminated: ok {rc=0} 14:05:35.516913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 14:05:36.604640 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:36.616275 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 14:05:36.657544 tst ping_idle_ping.py: using LAC 34455 14:05:36.779232 tst ping_idle_ping.py: using RAC 30 14:05:36.895832 tst ping_idle_ping.py: using CellId 34455 14:05:37.021371 tst ping_idle_ping.py: using BVCI 34456 14:05:37.136791 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.148205 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.159593 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.171043 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.182786 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.194537 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.206174 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 14:05:37.217882 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 14:05:37.334068 tst ping_idle_ping.py:24: start network... 14:05:37.532748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:37.995877 run create_hlr_db(pid=29532): Launched 14:05:38.118544 bus /gobi_6: Setting Powered False 14:05:39.178713 run create_hlr_db(pid=29532): Terminated: ok {rc=0} 14:05:39.594177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29534): Launched 14:05:39.891479 run osmo-hlr_10.42.42.2(pid=29535): Launched 14:05:40.004868 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:40.514886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29537): Launched 14:05:40.814028 run osmo-stp_10.42.42.5(pid=29538): Launched 14:05:40.926034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:41.437508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29540): Launched 14:05:41.551589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:41.804349 run patchelf(pid=29541): Launched 14:05:41.970628 run osmo-stp_10.42.42.5(pid=29538): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29538)] 14:05:42.096310 run osmo-stp_10.42.42.5(pid=29538): stdout: | (launched: 2022-12-13_14:05:40.758164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:42.223851 run osmo-stp_10.42.42.5(pid=29538): stderr: | 20221213140540923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140540924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140540924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140540924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140540925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140540925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140540925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:42.351258 run osmo-stp_10.42.42.5(pid=29538): stdout: | (launched: 2022-12-13_14:05:40.758164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:42.472545 run osmo-stp_10.42.42.5(pid=29538): stderr: | 20221213140540923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140540924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140540924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140540924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140540925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140540925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140540925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:42.616761 run patchelf(pid=29541): Terminating (SIGINT) 14:05:42.785110 run patchelf(pid=29541): Terminated: ok {rc=0} 14:05:42.905172 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29538): Process ended prematurely: osmo-stp_10.42.42.5(pid=29538) [trial-2390↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29538)] [trial-2390↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 14:05:42.914066 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 14:05:42.940292 run osmo-hlr_10.42.42.2(pid=29535): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29535)] 14:05:42.987339 run osmo-hlr_10.42.42.2(pid=29535): stdout: | (launched: 2022-12-13_14:05:39.836129) 14:05:43.035818 run osmo-hlr_10.42.42.2(pid=29535): stderr: | 20221213140540007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140540007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140540007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140540007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140540007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140540007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140540020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140540028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140540029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140540029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:43.084578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29534): Terminating (SIGTERM) 14:05:43.124145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29537): Terminating (SIGTERM) 14:05:43.163349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29540): Terminating (SIGTERM) 14:05:43.202901 --- ParallelTerminationStrategy: PID 29534 died... 14:05:43.221635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29534): Terminated: ok {rc=0} 14:05:43.265100 --- ParallelTerminationStrategy: PID 29537 died... 14:05:43.283496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29537): Terminated: ok {rc=0} 14:05:43.326645 --- ParallelTerminationStrategy: PID 29540 died... 14:05:43.345084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29540): Terminated: ok {rc=0} 14:05:43.426751 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 14:05:44.727836 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:44.734925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:05:44.759307 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:05:44.800702 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:05:44.890995 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:05:44.916335 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:05:44.955836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:05:45.549915 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:05:45.603069 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:45.614645 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:05:45.655794 tst cs_paging_gprs_active.py: using LAC 34456 14:05:45.785171 tst cs_paging_gprs_active.py: using RAC 31 14:05:45.939217 tst cs_paging_gprs_active.py: using CellId 34456 14:05:46.076289 tst cs_paging_gprs_active.py: using BVCI 34457 14:05:46.190258 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.202221 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.214044 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.225824 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.238519 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.251200 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.263975 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.276387 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:46.289202 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:05:46.435820 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:05:46.554898 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:05:46.778760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:47.118004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Launched 14:05:47.414857 run iperf3-srv_10.42.42.10(pid=29546): Launched 14:05:47.538326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:05:47.755767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:48.082752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Launched 14:05:48.365467 run iperf3-srv_10.42.42.10(pid=29548): Launched 14:05:48.487176 tst cs_paging_gprs_active.py:38: start network... 14:05:48.705861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:49.210556 run create_hlr_db(pid=29549): Launched 14:05:49.334135 bus /gobi_6: Setting Powered False 14:05:50.397629 run create_hlr_db(pid=29549): Terminated: ok {rc=0} 14:05:50.831003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Launched 14:05:51.133284 run osmo-hlr_10.42.42.2(pid=29552): Launched 14:05:51.248455 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:51.767785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Launched 14:05:52.094114 run osmo-stp_10.42.42.5(pid=29556): Launched 14:05:52.219324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:52.778712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29558): Launched 14:05:52.904358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:53.180333 run patchelf(pid=29559): Launched 14:05:53.361610 run osmo-stp_10.42.42.5(pid=29556): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29556)] 14:05:53.498917 run osmo-stp_10.42.42.5(pid=29556): stdout: | (launched: 2022-12-13_14:05:52.034335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:53.637423 run osmo-stp_10.42.42.5(pid=29556): stderr: | 20221213140552222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140552222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140552222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140552223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140552223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140552223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140552223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:53.776121 run osmo-stp_10.42.42.5(pid=29556): stdout: | (launched: 2022-12-13_14:05:52.034335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:53.908796 run osmo-stp_10.42.42.5(pid=29556): stderr: | 20221213140552222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140552222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140552222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140552223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140552223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140552223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140552223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:54.066610 run patchelf(pid=29559): Terminating (SIGINT) 14:05:54.247897 run patchelf(pid=29559): Terminated: ok {rc=0} 14:05:54.379225 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29556): Process ended prematurely: osmo-stp_10.42.42.5(pid=29556) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29556)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:05:54.389522 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 14:05:54.418024 run osmo-hlr_10.42.42.2(pid=29552): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29552)] 14:05:54.468471 run osmo-hlr_10.42.42.2(pid=29552): stdout: | (launched: 2022-12-13_14:05:51.076634) 14:05:54.520628 run osmo-hlr_10.42.42.2(pid=29552): stderr: | 20221213140551251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140551251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140551251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140551251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140551251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140551251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140551263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140551272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140551272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140551272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:54.573119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Terminating (SIGTERM) 14:05:54.614849 run iperf3-srv_10.42.42.10(pid=29546): Terminating (SIGTERM) 14:05:54.656941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminating (SIGTERM) 14:05:54.699093 run iperf3-srv_10.42.42.10(pid=29548): Terminating (SIGTERM) 14:05:54.741401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Terminating (SIGTERM) 14:05:54.783562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Terminating (SIGTERM) 14:05:54.825614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29558): Terminating (SIGTERM) 14:05:54.867967 --- ParallelTerminationStrategy: PID 29545 died... 14:05:54.888599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Terminated: ok {rc=0} 14:05:54.935152 --- ParallelTerminationStrategy: PID 29546 died... 14:05:54.955135 run iperf3-srv_10.42.42.10(pid=29546): Terminated {rc=256} 14:05:55.001524 --- ParallelTerminationStrategy: PID 29547 died... 14:05:55.021763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminated: ok {rc=0} 14:05:55.068036 --- ParallelTerminationStrategy: PID 29548 died... 14:05:55.087968 run iperf3-srv_10.42.42.10(pid=29548): Terminated {rc=256} 14:05:55.133947 --- ParallelTerminationStrategy: PID 29551 died... 14:05:55.153649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Terminated: ok {rc=0} 14:05:55.199814 --- ParallelTerminationStrategy: PID 29554 died... 14:05:55.219780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Terminated: ok {rc=0} 14:05:55.266688 --- ParallelTerminationStrategy: PID 29558 died... 14:05:55.286843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29558): Terminated: ok {rc=0} 14:05:55.375149 bus /gobi_0: Setting Powered False 14:05:56.472788 bus /gobi_0: Setting Powered False 14:05:57.588104 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:05:58.735991 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:58.748138 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:05:58.792344 tst iperf3.py: using LAC 34457 14:05:58.920347 tst iperf3.py: using RAC 32 14:05:59.048178 tst iperf3.py: using CellId 34457 14:05:59.168755 tst iperf3.py: using BVCI 34458 14:05:59.279762 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.291150 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.302221 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.313095 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.323659 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.334295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.345454 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.356065 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:05:59.366867 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:05:59.486359 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:05:59.706480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:00.032729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29560): Launched 14:06:00.317416 run iperf3-srv_10.42.42.10(pid=29561): Launched 14:06:00.439550 tst iperf3.py:8: start network... 14:06:00.658076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:01.177209 run create_hlr_db(pid=29562): Launched 14:06:01.349615 bus /gobi_6: Setting Powered False 14:06:02.413683 run create_hlr_db(pid=29562): Terminated: ok {rc=0} 14:06:02.846760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29564): Launched 14:06:03.150386 run osmo-hlr_10.42.42.2(pid=29565): Launched 14:06:03.264379 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:03.785265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29567): Launched 14:06:04.088237 run osmo-stp_10.42.42.5(pid=29568): Launched 14:06:04.202367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:04.723134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29570): Launched 14:06:04.839347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:05.094925 run patchelf(pid=29571): Launched 14:06:05.262279 run osmo-stp_10.42.42.5(pid=29568): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29568)] 14:06:05.389637 run osmo-stp_10.42.42.5(pid=29568): stdout: | (launched: 2022-12-13_14:06:04.032098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:05.518634 run osmo-stp_10.42.42.5(pid=29568): stderr: | 20221213140604200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140604201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140604201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140604201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140604202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140604202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140604202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:05.648238 run osmo-stp_10.42.42.5(pid=29568): stdout: | (launched: 2022-12-13_14:06:04.032098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:05.771469 run osmo-stp_10.42.42.5(pid=29568): stderr: | 20221213140604200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140604201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140604201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140604201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140604202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140604202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140604202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:05.917795 run patchelf(pid=29571): Terminating (SIGINT) 14:06:06.087624 run patchelf(pid=29571): Terminated: ok {rc=0} 14:06:06.210445 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29568): Process ended prematurely: osmo-stp_10.42.42.5(pid=29568) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29568)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 14:06:06.219837 tst iperf3.py:8: Test FAILED (7.5 sec) 14:06:06.246790 run osmo-hlr_10.42.42.2(pid=29565): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29565)] 14:06:06.293674 run osmo-hlr_10.42.42.2(pid=29565): stdout: | (launched: 2022-12-13_14:06:03.094199) 14:06:06.342378 run osmo-hlr_10.42.42.2(pid=29565): stderr: | 20221213140603269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140603269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140603269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140603269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140603269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140603269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140603281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140603290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140603290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140603291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:06.391569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29560): Terminating (SIGTERM) 14:06:06.431249 run iperf3-srv_10.42.42.10(pid=29561): Terminating (SIGTERM) 14:06:06.470890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29564): Terminating (SIGTERM) 14:06:06.510307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29567): Terminating (SIGTERM) 14:06:06.549658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29570): Terminating (SIGTERM) 14:06:06.589421 --- ParallelTerminationStrategy: PID 29560 died... 14:06:06.608393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29560): Terminated: ok {rc=0} 14:06:06.652349 --- ParallelTerminationStrategy: PID 29561 died... 14:06:06.670956 run iperf3-srv_10.42.42.10(pid=29561): Terminated {rc=256} 14:06:06.714378 --- ParallelTerminationStrategy: PID 29564 died... 14:06:06.733018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29564): Terminated: ok {rc=0} 14:06:06.776426 --- ParallelTerminationStrategy: PID 29567 died... 14:06:06.795020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29567): Terminated: ok {rc=0} 14:06:06.838742 --- ParallelTerminationStrategy: PID 29570 died... 14:06:06.857593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29570): Terminated: ok {rc=0} 14:06:06.942973 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:06:08.089348 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.100792 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:06:08.143647 tst iperf3m4.py: using LAC 34458 14:06:08.262685 tst iperf3m4.py: using RAC 33 14:06:08.384155 tst iperf3m4.py: using CellId 34458 14:06:08.505857 tst iperf3m4.py: using BVCI 34459 14:06:08.617402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.628329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.639238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.650029 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.661219 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.672452 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.683913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.695099 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:08.706517 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:08.827346 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:08.947946 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:09.070005 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:09.189105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:06:09.391283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:09.694564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29572): Launched 14:06:09.961040 run iperf3-srv_10.42.42.10(pid=29573): Launched 14:06:10.075414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:06:10.278384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:10.583725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29574): Launched 14:06:10.850443 run iperf3-srv_10.42.42.10(pid=29575): Launched 14:06:10.965239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:06:11.167253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:11.471034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Launched 14:06:11.734661 run iperf3-srv_10.42.42.10(pid=29577): Launched 14:06:11.848401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:06:12.050523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:12.354494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Launched 14:06:12.620086 run iperf3-srv_10.42.42.10(pid=29579): Launched 14:06:12.735705 tst iperf3m4.py:8: start network... 14:06:12.938590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:13.407744 run create_hlr_db(pid=29580): Launched 14:06:13.532417 bus /gobi_6: Setting Powered False 14:06:14.593291 run create_hlr_db(pid=29580): Terminated: ok {rc=0} 14:06:15.035560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Launched 14:06:15.361081 run osmo-hlr_10.42.42.2(pid=29583): Launched 14:06:15.485561 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:16.083987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Launched 14:06:16.426381 run osmo-stp_10.42.42.5(pid=29586): Launched 14:06:16.776725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:17.341297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Launched 14:06:17.465277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:17.739224 run patchelf(pid=29589): Launched 14:06:17.920791 run osmo-stp_10.42.42.5(pid=29586): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29586)] 14:06:18.058392 run osmo-stp_10.42.42.5(pid=29586): stdout: | (launched: 2022-12-13_14:06:16.363859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:18.196712 run osmo-stp_10.42.42.5(pid=29586): stderr: | 20221213140616583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140616583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140616584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140616584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140616585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140616585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140616585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:18.335322 run osmo-stp_10.42.42.5(pid=29586): stdout: | (launched: 2022-12-13_14:06:16.363859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:18.467832 run osmo-stp_10.42.42.5(pid=29586): stderr: | 20221213140616583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140616583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140616584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140616584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140616585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140616585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140616585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:18.625126 run patchelf(pid=29589): Terminating (SIGINT) 14:06:18.806938 run patchelf(pid=29589): Terminated: ok {rc=0} 14:06:18.938133 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29586): Process ended prematurely: osmo-stp_10.42.42.5(pid=29586) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29586)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 14:06:18.948307 tst iperf3m4.py:8: Test FAILED (10.9 sec) 14:06:18.977180 run osmo-hlr_10.42.42.2(pid=29583): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29583)] 14:06:19.027963 run osmo-hlr_10.42.42.2(pid=29583): stdout: | (launched: 2022-12-13_14:06:15.301105) 14:06:19.080331 run osmo-hlr_10.42.42.2(pid=29583): stderr: | 20221213140615496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140615496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140615496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140615496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140615496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140615496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140615510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140615519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140615519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140615519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:19.132670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29572): Terminating (SIGTERM) 14:06:19.174118 run iperf3-srv_10.42.42.10(pid=29573): Terminating (SIGTERM) 14:06:19.216263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29574): Terminating (SIGTERM) 14:06:19.258213 run iperf3-srv_10.42.42.10(pid=29575): Terminating (SIGTERM) 14:06:19.299761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Terminating (SIGTERM) 14:06:19.342093 run iperf3-srv_10.42.42.10(pid=29577): Terminating (SIGTERM) 14:06:19.383717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Terminating (SIGTERM) 14:06:19.425725 run iperf3-srv_10.42.42.10(pid=29579): Terminating (SIGTERM) 14:06:19.467429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Terminating (SIGTERM) 14:06:19.509262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Terminating (SIGTERM) 14:06:19.551129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Terminating (SIGTERM) 14:06:19.593695 --- ParallelTerminationStrategy: PID 29572 died... 14:06:19.613763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29572): Terminated: ok {rc=0} 14:06:19.660026 --- ParallelTerminationStrategy: PID 29573 died... 14:06:19.679631 run iperf3-srv_10.42.42.10(pid=29573): Terminated {rc=256} 14:06:19.727369 --- ParallelTerminationStrategy: PID 29574 died... 14:06:19.746737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29574): Terminated: ok {rc=0} 14:06:19.790831 --- ParallelTerminationStrategy: PID 29575 died... 14:06:19.809956 run iperf3-srv_10.42.42.10(pid=29575): Terminated {rc=256} 14:06:19.854113 --- ParallelTerminationStrategy: PID 29576 died... 14:06:19.873403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Terminated: ok {rc=0} 14:06:19.916934 --- ParallelTerminationStrategy: PID 29577 died... 14:06:19.936659 run iperf3-srv_10.42.42.10(pid=29577): Terminated {rc=256} 14:06:19.980659 --- ParallelTerminationStrategy: PID 29578 died... 14:06:19.999776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Terminated: ok {rc=0} 14:06:20.043963 --- ParallelTerminationStrategy: PID 29579 died... 14:06:20.063148 run iperf3-srv_10.42.42.10(pid=29579): Terminated {rc=256} 14:06:20.107250 --- ParallelTerminationStrategy: PID 29582 died... 14:06:20.126452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29582): Terminated: ok {rc=0} 14:06:20.170263 --- ParallelTerminationStrategy: PID 29585 died... 14:06:20.189678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29585): Terminated: ok {rc=0} 14:06:20.233576 --- ParallelTerminationStrategy: PID 29588 died... 14:06:20.252801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29588): Terminated: ok {rc=0} 14:06:20.339648 bus /gobi_4: Setting Powered False 14:06:21.439137 bus /gobi_4: Setting Powered False 14:06:22.554491 bus /gobi_1: Setting Powered False 14:06:23.652649 bus /gobi_1: Setting Powered False 14:06:24.766214 bus /gobi_0: Setting Powered False 14:06:25.863741 bus /gobi_0: Setting Powered False 14:06:26.981299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 14:06:28.083384 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.095563 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:06:28.138711 tst ping.py: using LAC 34459 14:06:28.257784 tst ping.py: using RAC 34 14:06:28.375256 tst ping.py: using CellId 34459 14:06:28.493993 tst ping.py: using BVCI 34460 14:06:28.603353 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.614442 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.625599 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.636310 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.647018 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.657725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.668633 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:28.679452 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:28.800048 tst ping.py:19: start network... 14:06:29.013145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:29.504382 run create_hlr_db(pid=29590): Launched 14:06:29.627699 bus /gobi_6: Setting Powered False 14:06:30.689971 run create_hlr_db(pid=29590): Terminated: ok {rc=0} 14:06:31.151477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29592): Launched 14:06:31.486782 run osmo-hlr_10.42.42.2(pid=29593): Launched 14:06:31.668352 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:32.294325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29595): Launched 14:06:32.614569 run osmo-stp_10.42.42.5(pid=29596): Launched 14:06:32.735030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:33.283177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29598): Launched 14:06:33.406007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:33.674783 run patchelf(pid=29599): Launched 14:06:33.853311 run osmo-stp_10.42.42.5(pid=29596): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29596)] 14:06:33.987986 run osmo-stp_10.42.42.5(pid=29596): stdout: | (launched: 2022-12-13_14:06:32.555581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:34.125630 run osmo-stp_10.42.42.5(pid=29596): stderr: | 20221213140632743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140632743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140632744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140632744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140632745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140632745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140632745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:34.262676 run osmo-stp_10.42.42.5(pid=29596): stdout: | (launched: 2022-12-13_14:06:32.555581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:34.393301 run osmo-stp_10.42.42.5(pid=29596): stderr: | 20221213140632743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140632743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140632744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140632744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140632745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140632745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140632745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:34.547653 run patchelf(pid=29599): Terminating (SIGINT) 14:06:34.726812 run patchelf(pid=29599): Terminated: ok {rc=0} 14:06:34.855591 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29596): Process ended prematurely: osmo-stp_10.42.42.5(pid=29596) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29596)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 14:06:34.865577 tst ping.py:22: Test FAILED (6.8 sec) 14:06:34.893532 run osmo-hlr_10.42.42.2(pid=29593): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29593)] 14:06:34.944559 run osmo-hlr_10.42.42.2(pid=29593): stdout: | (launched: 2022-12-13_14:06:31.427211) 14:06:34.996101 run osmo-hlr_10.42.42.2(pid=29593): stderr: | 20221213140631726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140631726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140631726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140631726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140631726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140631726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140631741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140631750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140631750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140631750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:35.048445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29592): Terminating (SIGTERM) 14:06:35.090426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29595): Terminating (SIGTERM) 14:06:35.132453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29598): Terminating (SIGTERM) 14:06:35.174640 --- ParallelTerminationStrategy: PID 29592 died... 14:06:35.194522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29592): Terminated: ok {rc=0} 14:06:35.240872 --- ParallelTerminationStrategy: PID 29595 died... 14:06:35.261469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29595): Terminated: ok {rc=0} 14:06:35.307881 --- ParallelTerminationStrategy: PID 29598 died... 14:06:35.328053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29598): Terminated: ok {rc=0} 14:06:35.417311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:06:36.503998 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:36.516189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:06:36.564488 tst ping_idle_ping.py: using LAC 34460 14:06:36.691949 tst ping_idle_ping.py: using RAC 35 14:06:36.816288 tst ping_idle_ping.py: using CellId 34460 14:06:36.939867 tst ping_idle_ping.py: using BVCI 34461 14:06:37.056465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.068105 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.079667 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.091108 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.103196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.114591 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.126338 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:06:37.137675 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:06:37.259155 tst ping_idle_ping.py:24: start network... 14:06:37.473168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:37.972656 run create_hlr_db(pid=29600): Launched 14:06:38.094896 bus /gobi_6: Setting Powered False 14:06:39.158634 run create_hlr_db(pid=29600): Terminated: ok {rc=0} 14:06:39.586958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Launched 14:06:39.885752 run osmo-hlr_10.42.42.2(pid=29603): Launched 14:06:40.000722 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:40.532668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Launched 14:06:40.830400 run osmo-stp_10.42.42.5(pid=29606): Launched 14:06:40.943132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:41.455812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Launched 14:06:41.569273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:41.820528 run patchelf(pid=29609): Launched 14:06:41.986119 run osmo-stp_10.42.42.5(pid=29606): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] 14:06:42.112423 run osmo-stp_10.42.42.5(pid=29606): stdout: | (launched: 2022-12-13_14:06:40.775116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:42.240366 run osmo-stp_10.42.42.5(pid=29606): stderr: | 20221213140640942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140640942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140640942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140640942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140640943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140640943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140640943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:42.368169 run osmo-stp_10.42.42.5(pid=29606): stdout: | (launched: 2022-12-13_14:06:40.775116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:42.489795 run osmo-stp_10.42.42.5(pid=29606): stderr: | 20221213140640942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140640942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140640942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140640942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140640943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140640943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140640943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:42.633870 run patchelf(pid=29609): Terminating (SIGINT) 14:06:42.801453 run patchelf(pid=29609): Terminated: ok {rc=0} 14:06:42.922553 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29606): Process ended prematurely: osmo-stp_10.42.42.5(pid=29606) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 14:06:42.931283 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 14:06:42.957876 run osmo-hlr_10.42.42.2(pid=29603): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29603)] 14:06:43.005300 run osmo-hlr_10.42.42.2(pid=29603): stdout: | (launched: 2022-12-13_14:06:39.830162) 14:06:43.054137 run osmo-hlr_10.42.42.2(pid=29603): stderr: | 20221213140640003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140640003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140640003 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140640003 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140640003 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140640003 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140640015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140640024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140640024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140640024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:43.103218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Terminating (SIGTERM) 14:06:43.143289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Terminating (SIGTERM) 14:06:43.182857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Terminating (SIGTERM) 14:06:43.222626 --- ParallelTerminationStrategy: PID 29602 died... 14:06:43.242014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Terminated: ok {rc=0} 14:06:43.286049 --- ParallelTerminationStrategy: PID 29605 died... 14:06:43.304757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Terminated: ok {rc=0} 14:06:43.348511 --- ParallelTerminationStrategy: PID 29608 died... 14:06:43.367221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Terminated: ok {rc=0} 14:06:43.449844 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:06:44.747009 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:44.754762 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:06:44.778948 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:06:44.818804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:06:44.907289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:06:44.931564 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:06:44.970898 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:06:45.570884 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:06:45.621374 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:45.632401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:06:45.691570 tst cs_paging_gprs_active.py: using LAC 34461 14:06:45.812515 tst cs_paging_gprs_active.py: using RAC 36 14:06:45.971648 tst cs_paging_gprs_active.py: using CellId 34461 14:06:46.103137 tst cs_paging_gprs_active.py: using BVCI 34462 14:06:46.250007 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.261937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.273704 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.286557 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.298703 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.310258 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.322004 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.333547 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:46.345402 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:06:46.464847 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:06:46.585330 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:06:46.794486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:47.112623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Launched 14:06:47.386847 run iperf3-srv_10.42.42.10(pid=29615): Launched 14:06:47.502025 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:06:47.703716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:48.007142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Launched 14:06:48.270965 run iperf3-srv_10.42.42.10(pid=29617): Launched 14:06:48.384159 tst cs_paging_gprs_active.py:38: start network... 14:06:48.586230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:49.055591 run create_hlr_db(pid=29618): Launched 14:06:49.181259 bus /gobi_6: Setting Powered False 14:06:50.245735 run create_hlr_db(pid=29618): Terminated: ok {rc=0} 14:06:50.681903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Launched 14:06:50.985896 run osmo-hlr_10.42.42.2(pid=29621): Launched 14:06:51.100782 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:51.625163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Launched 14:06:51.927740 run osmo-stp_10.42.42.5(pid=29624): Launched 14:06:52.042132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:52.563589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Launched 14:06:52.678742 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:52.935293 run patchelf(pid=29627): Launched 14:06:53.103239 run osmo-stp_10.42.42.5(pid=29624): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] 14:06:53.231731 run osmo-stp_10.42.42.5(pid=29624): stdout: | (launched: 2022-12-13_14:06:51.871008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:53.361241 run osmo-stp_10.42.42.5(pid=29624): stderr: | 20221213140652039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140652039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140652040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140652040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140652041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140652041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140652041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:53.490579 run osmo-stp_10.42.42.5(pid=29624): stdout: | (launched: 2022-12-13_14:06:51.871008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:53.614016 run osmo-stp_10.42.42.5(pid=29624): stderr: | 20221213140652039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140652039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140652040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140652040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140652041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140652041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140652041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:53.759898 run patchelf(pid=29627): Terminating (SIGINT) 14:06:53.929522 run patchelf(pid=29627): Terminated: ok {rc=0} 14:06:54.052085 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29624): Process ended prematurely: osmo-stp_10.42.42.5(pid=29624) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:06:54.061551 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:06:54.088462 run osmo-hlr_10.42.42.2(pid=29621): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29621)] 14:06:54.135747 run osmo-hlr_10.42.42.2(pid=29621): stdout: | (launched: 2022-12-13_14:06:50.929095) 14:06:54.184430 run osmo-hlr_10.42.42.2(pid=29621): stderr: | 20221213140651102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140651103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140651103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140651103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140651103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140651103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140651115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140651124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140651125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140651125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:54.233740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Terminating (SIGTERM) 14:06:54.273232 run iperf3-srv_10.42.42.10(pid=29615): Terminating (SIGTERM) 14:06:54.312648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Terminating (SIGTERM) 14:06:54.351993 run iperf3-srv_10.42.42.10(pid=29617): Terminating (SIGTERM) 14:06:54.391386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Terminating (SIGTERM) 14:06:54.430991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Terminating (SIGTERM) 14:06:54.470422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Terminating (SIGTERM) 14:06:54.509973 --- ParallelTerminationStrategy: PID 29614 died... 14:06:54.529350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Terminated: ok {rc=0} 14:06:54.573287 --- ParallelTerminationStrategy: PID 29615 died... 14:06:54.591929 run iperf3-srv_10.42.42.10(pid=29615): Terminated {rc=256} 14:06:54.635470 --- ParallelTerminationStrategy: PID 29616 died... 14:06:54.654598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Terminated: ok {rc=0} 14:06:54.698832 --- ParallelTerminationStrategy: PID 29617 died... 14:06:54.717705 run iperf3-srv_10.42.42.10(pid=29617): Terminated {rc=256} 14:06:54.761268 --- ParallelTerminationStrategy: PID 29620 died... 14:06:54.780012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Terminated: ok {rc=0} 14:06:54.823733 --- ParallelTerminationStrategy: PID 29623 died... 14:06:54.843183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Terminated: ok {rc=0} 14:06:54.887047 --- ParallelTerminationStrategy: PID 29626 died... 14:06:54.905556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Terminated: ok {rc=0} 14:06:54.989120 bus /gobi_0: Setting Powered False 14:06:56.086693 bus /gobi_0: Setting Powered False 14:06:57.202121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:06:58.351701 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.363859 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:06:58.428312 tst iperf3.py: using LAC 34462 14:06:58.555108 tst iperf3.py: using RAC 37 14:06:58.683480 tst iperf3.py: using CellId 34462 14:06:58.810426 tst iperf3.py: using BVCI 34463 14:06:58.930938 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.942665 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.954199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.965716 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.977552 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:58.989405 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:59.001107 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:59.012597 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:06:59.024591 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:06:59.142811 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:06:59.348402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:59.654260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29628): Launched 14:06:59.918515 run iperf3-srv_10.42.42.10(pid=29629): Launched 14:07:00.034691 tst iperf3.py:8: start network... 14:07:00.238150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:00.706827 run create_hlr_db(pid=29630): Launched 14:07:00.830632 bus /gobi_6: Setting Powered False 14:07:01.894196 run create_hlr_db(pid=29630): Terminated: ok {rc=0} 14:07:02.352539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29632): Launched 14:07:02.678050 run osmo-hlr_10.42.42.2(pid=29633): Launched 14:07:02.801076 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:03.364869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29635): Launched 14:07:03.690240 run osmo-stp_10.42.42.5(pid=29636): Launched 14:07:03.815518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:07:04.374662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29638): Launched 14:07:04.499262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:07:04.774771 run patchelf(pid=29639): Launched 14:07:04.957050 run osmo-stp_10.42.42.5(pid=29636): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29636)] 14:07:05.094651 run osmo-stp_10.42.42.5(pid=29636): stdout: | (launched: 2022-12-13_14:07:03.630475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:05.233576 run osmo-stp_10.42.42.5(pid=29636): stderr: | 20221213140703821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140703821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140703821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140703822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140703822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140703822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140703822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:05.372373 run osmo-stp_10.42.42.5(pid=29636): stdout: | (launched: 2022-12-13_14:07:03.630475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:05.505370 run osmo-stp_10.42.42.5(pid=29636): stderr: | 20221213140703821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140703821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140703821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140703822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140703822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140703822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140703822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:05.663014 run patchelf(pid=29639): Terminating (SIGINT) 14:07:05.845437 run patchelf(pid=29639): Terminated: ok {rc=0} 14:07:05.976360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29636): Process ended prematurely: osmo-stp_10.42.42.5(pid=29636) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29636)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 14:07:05.986766 tst iperf3.py:8: Test FAILED (7.7 sec) 14:07:06.015244 run osmo-hlr_10.42.42.2(pid=29633): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29633)] 14:07:06.066262 run osmo-hlr_10.42.42.2(pid=29633): stdout: | (launched: 2022-12-13_14:07:02.617703) 14:07:06.118456 run osmo-hlr_10.42.42.2(pid=29633): stderr: | 20221213140702815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140702815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140702815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140702815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140702815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140702815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140702827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140702836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140702836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140702836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:06.170695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29628): Terminating (SIGTERM) 14:07:06.212506 run iperf3-srv_10.42.42.10(pid=29629): Terminating (SIGTERM) 14:07:06.254620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29632): Terminating (SIGTERM) 14:07:06.296597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29635): Terminating (SIGTERM) 14:07:06.338671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29638): Terminating (SIGTERM) 14:07:06.381049 --- ParallelTerminationStrategy: PID 29628 died... 14:07:06.401702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29628): Terminated: ok {rc=0} 14:07:06.448292 --- ParallelTerminationStrategy: PID 29629 died... 14:07:06.468280 run iperf3-srv_10.42.42.10(pid=29629): Terminated {rc=256} 14:07:06.514558 --- ParallelTerminationStrategy: PID 29632 died... 14:07:06.534702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29632): Terminated: ok {rc=0} 14:07:06.581126 --- ParallelTerminationStrategy: PID 29635 died... 14:07:06.601144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29635): Terminated: ok {rc=0} 14:07:06.647734 --- ParallelTerminationStrategy: PID 29638 died... 14:07:06.667901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29638): Terminated: ok {rc=0} 14:07:06.756586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:07:07.903942 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:07.915664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:07:07.975687 tst iperf3m4.py: using LAC 34463 14:07:08.094632 tst iperf3m4.py: using RAC 38 14:07:08.223653 tst iperf3m4.py: using CellId 34463 14:07:08.350330 tst iperf3m4.py: using BVCI 34464 14:07:08.469099 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.480741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.492230 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.503758 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.515457 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.527515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.539455 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.551128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:08.563048 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:08.685230 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:08.804876 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:08.922323 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:09.038927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:07:09.258638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:07:09.584105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29640): Launched 14:07:09.867070 run iperf3-srv_10.42.42.10(pid=29641): Launched 14:07:09.991280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:07:10.210181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:07:10.535996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29642): Launched 14:07:10.817776 run iperf3-srv_10.42.42.10(pid=29643): Launched 14:07:10.942165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:07:11.162101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:07:11.489582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Launched 14:07:11.774583 run iperf3-srv_10.42.42.10(pid=29645): Launched 14:07:11.898195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:07:12.117102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:07:12.442709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29646): Launched 14:07:12.726882 run iperf3-srv_10.42.42.10(pid=29647): Launched 14:07:12.850483 tst iperf3m4.py:8: start network... 14:07:13.068778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:13.572509 run create_hlr_db(pid=29648): Launched 14:07:13.696477 bus /gobi_6: Setting Powered False 14:07:14.760493 run create_hlr_db(pid=29648): Terminated: ok {rc=0} 14:07:15.193309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Launched 14:07:15.497393 run osmo-hlr_10.42.42.2(pid=29651): Launched 14:07:15.613931 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:16.197766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Launched 14:07:16.549440 run osmo-stp_10.42.42.5(pid=29654): Launched 14:07:16.688229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:07:17.394111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29656): Launched 14:07:17.510400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:07:17.767827 run patchelf(pid=29657): Launched 14:07:17.937359 run osmo-stp_10.42.42.5(pid=29654): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] 14:07:18.064434 run osmo-stp_10.42.42.5(pid=29654): stdout: | (launched: 2022-12-13_14:07:16.480152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:18.193291 run osmo-stp_10.42.42.5(pid=29654): stderr: | 20221213140716829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140716829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140716830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:18.321871 run osmo-stp_10.42.42.5(pid=29654): stdout: | (launched: 2022-12-13_14:07:16.480152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:18.444860 run osmo-stp_10.42.42.5(pid=29654): stderr: | 20221213140716829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140716829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140716830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:18.590824 run patchelf(pid=29657): Terminating (SIGINT) 14:07:18.760761 run patchelf(pid=29657): Terminated: ok {rc=0} 14:07:18.882978 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29654): Process ended prematurely: osmo-stp_10.42.42.5(pid=29654) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:07:18.892497 tst iperf3m4.py:8: Test FAILED (11.0 sec) 14:07:18.919796 run osmo-hlr_10.42.42.2(pid=29651): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29651)] 14:07:18.966569 run osmo-hlr_10.42.42.2(pid=29651): stdout: | (launched: 2022-12-13_14:07:15.441074) 14:07:19.015027 run osmo-hlr_10.42.42.2(pid=29651): stderr: | 20221213140715615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140715615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140715615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140715616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140715616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140715616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140715628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140715636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140715637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140715637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:19.064030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29640): Terminating (SIGTERM) 14:07:19.103698 run iperf3-srv_10.42.42.10(pid=29641): Terminating (SIGTERM) 14:07:19.143102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29642): Terminating (SIGTERM) 14:07:19.182648 run iperf3-srv_10.42.42.10(pid=29643): Terminating (SIGTERM) 14:07:19.222204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Terminating (SIGTERM) 14:07:19.261674 run iperf3-srv_10.42.42.10(pid=29645): Terminating (SIGTERM) 14:07:19.301180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29646): Terminating (SIGTERM) 14:07:19.340575 run iperf3-srv_10.42.42.10(pid=29647): Terminating (SIGTERM) 14:07:19.379995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Terminating (SIGTERM) 14:07:19.420052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Terminating (SIGTERM) 14:07:19.459543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29656): Terminating (SIGTERM) 14:07:19.499088 --- ParallelTerminationStrategy: PID 29640 died... 14:07:19.518310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29640): Terminated: ok {rc=0} 14:07:19.561974 --- ParallelTerminationStrategy: PID 29641 died... 14:07:19.580614 run iperf3-srv_10.42.42.10(pid=29641): Terminated {rc=256} 14:07:19.623803 --- ParallelTerminationStrategy: PID 29642 died... 14:07:19.642202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29642): Terminated: ok {rc=0} 14:07:19.685378 --- ParallelTerminationStrategy: PID 29643 died... 14:07:19.703983 run iperf3-srv_10.42.42.10(pid=29643): Terminated {rc=256} 14:07:19.747214 --- ParallelTerminationStrategy: PID 29644 died... 14:07:19.765954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Terminated: ok {rc=0} 14:07:19.809458 --- ParallelTerminationStrategy: PID 29645 died... 14:07:19.827943 run iperf3-srv_10.42.42.10(pid=29645): Terminated {rc=256} 14:07:19.871197 --- ParallelTerminationStrategy: PID 29646 died... 14:07:19.889840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29646): Terminated: ok {rc=0} 14:07:19.933267 --- ParallelTerminationStrategy: PID 29647 died... 14:07:19.951700 run iperf3-srv_10.42.42.10(pid=29647): Terminated {rc=256} 14:07:19.995143 --- ParallelTerminationStrategy: PID 29650 died... 14:07:20.013804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Terminated: ok {rc=0} 14:07:20.057204 --- ParallelTerminationStrategy: PID 29653 died... 14:07:20.075854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Terminated: ok {rc=0} 14:07:20.119465 --- ParallelTerminationStrategy: PID 29656 died... 14:07:20.138233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29656): Terminated: ok {rc=0} 14:07:20.223470 bus /gobi_4: Setting Powered False 14:07:21.321593 bus /gobi_4: Setting Powered False 14:07:22.435371 bus /gobi_1: Setting Powered False 14:07:23.533251 bus /gobi_1: Setting Powered False 14:07:24.648850 bus /gobi_0: Setting Powered False 14:07:25.746152 bus /gobi_0: Setting Powered False 14:07:26.863038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:07:27.965255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:27.977546 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:07:28.040402 tst ping.py: using LAC 34464 14:07:28.165289 tst ping.py: using RAC 39 14:07:28.288325 tst ping.py: using CellId 34464 14:07:28.412727 tst ping.py: using BVCI 34465 14:07:28.530170 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.542017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.553662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.565528 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.577420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.589372 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.601309 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:28.613175 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:28.732083 tst ping.py:19: start network... 14:07:28.956373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:29.448197 run create_hlr_db(pid=29658): Launched 14:07:29.570508 bus /gobi_6: Setting Powered False 14:07:30.633060 run create_hlr_db(pid=29658): Terminated: ok {rc=0} 14:07:31.090342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Launched 14:07:31.485272 run osmo-hlr_10.42.42.2(pid=29661): Launched 14:07:31.659947 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:32.391956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Launched 14:07:32.689693 run osmo-stp_10.42.42.5(pid=29664): Launched 14:07:32.803235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:07:33.319504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29666): Launched 14:07:33.432477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:07:33.683714 run patchelf(pid=29667): Launched 14:07:33.847819 run osmo-stp_10.42.42.5(pid=29664): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] 14:07:33.973295 run osmo-stp_10.42.42.5(pid=29664): stdout: | (launched: 2022-12-13_14:07:32.634204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:34.100489 run osmo-stp_10.42.42.5(pid=29664): stderr: | 20221213140732801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140732801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140732801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140732802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140732802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140732802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140732802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:34.227608 run osmo-stp_10.42.42.5(pid=29664): stdout: | (launched: 2022-12-13_14:07:32.634204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:34.348864 run osmo-stp_10.42.42.5(pid=29664): stderr: | 20221213140732801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140732801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140732801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140732802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140732802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140732802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140732802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:34.492139 run patchelf(pid=29667): Terminating (SIGINT) 14:07:34.658767 run patchelf(pid=29667): Terminated: ok {rc=0} 14:07:34.779040 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29664): Process ended prematurely: osmo-stp_10.42.42.5(pid=29664) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 14:07:34.787964 tst ping.py:22: Test FAILED (6.8 sec) 14:07:34.814275 run osmo-hlr_10.42.42.2(pid=29661): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29661)] 14:07:34.861239 run osmo-hlr_10.42.42.2(pid=29661): stdout: | (launched: 2022-12-13_14:07:31.429230) 14:07:34.909872 run osmo-hlr_10.42.42.2(pid=29661): stderr: | 20221213140731782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140731782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140731782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140731782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140731783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140731783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140731799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140731807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140731807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140731807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:34.958697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Terminating (SIGTERM) 14:07:34.998114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Terminating (SIGTERM) 14:07:35.037366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29666): Terminating (SIGTERM) 14:07:35.077739 --- ParallelTerminationStrategy: PID 29660 died... 14:07:35.096892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Terminated: ok {rc=0} 14:07:35.140778 --- ParallelTerminationStrategy: PID 29663 died... 14:07:35.159406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Terminated: ok {rc=0} 14:07:35.202952 --- ParallelTerminationStrategy: PID 29666 died... 14:07:35.221599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29666): Terminated: ok {rc=0} 14:07:35.306626 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:07:36.393900 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:36.405655 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:07:36.466495 tst ping_idle_ping.py: using LAC 34465 14:07:36.585417 tst ping_idle_ping.py: using RAC 40 14:07:36.710925 tst ping_idle_ping.py: using CellId 34465 14:07:36.836062 tst ping_idle_ping.py: using BVCI 34466 14:07:36.951949 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:36.963604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:36.975162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:36.986752 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:36.998464 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:37.010296 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:37.022178 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:07:37.033906 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:07:37.150948 tst ping_idle_ping.py:24: start network... 14:07:37.350195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:37.814181 run create_hlr_db(pid=29668): Launched 14:07:37.937209 bus /gobi_6: Setting Powered False 14:07:38.996609 run create_hlr_db(pid=29668): Terminated: ok {rc=0} 14:07:39.431061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Launched 14:07:39.751619 run osmo-hlr_10.42.42.2(pid=29671): Launched 14:07:39.874080 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:40.424030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Launched 14:07:40.744042 run osmo-stp_10.42.42.5(pid=29674): Launched 14:07:40.866095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:07:41.420634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29676): Launched 14:07:41.542259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:07:41.811736 run patchelf(pid=29677): Launched 14:07:41.987927 run osmo-stp_10.42.42.5(pid=29674): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] 14:07:42.123208 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-13_14:07:40.685367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:42.259702 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221213140740874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140740874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140740874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140740875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140740875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140740875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140740875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:42.395934 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-13_14:07:40.685367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:42.526136 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221213140740874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140740874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140740874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140740875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140740875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140740875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140740875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:42.680414 run patchelf(pid=29677): Terminating (SIGINT) 14:07:42.859107 run patchelf(pid=29677): Terminated: ok {rc=0} 14:07:42.987880 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:07:42.997463 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:07:43.025276 run osmo-hlr_10.42.42.2(pid=29671): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29671)] 14:07:43.076231 run osmo-hlr_10.42.42.2(pid=29671): stdout: | (launched: 2022-12-13_14:07:39.692941) 14:07:43.127791 run osmo-hlr_10.42.42.2(pid=29671): stderr: | 20221213140739887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140739887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140739888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140739888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140739888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140739888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140739900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140739908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140739908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140739908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:43.179678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminating (SIGTERM) 14:07:43.221084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminating (SIGTERM) 14:07:43.263245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29676): Terminating (SIGTERM) 14:07:43.305514 --- ParallelTerminationStrategy: PID 29670 died... 14:07:43.326103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminated: ok {rc=0} 14:07:43.372335 --- ParallelTerminationStrategy: PID 29673 died... 14:07:43.392516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminated: ok {rc=0} 14:07:43.438590 --- ParallelTerminationStrategy: PID 29676 died... 14:07:43.458444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29676): Terminated: ok {rc=0} 14:07:43.545393 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 14:07:44.840177 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:44.847664 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:07:44.871211 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:07:44.905510 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:07:44.959339 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:07:44.983647 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:07:45.017906 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:07:45.581852 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:07:45.588353 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:45.600168 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:07:45.660457 tst switch_tch_pdch.py: using LAC 34466 14:07:45.780840 tst switch_tch_pdch.py: using RAC 41 14:07:45.908012 tst switch_tch_pdch.py: using CellId 34466 14:07:46.046636 tst switch_tch_pdch.py: using BVCI 34467 14:07:46.167040 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.180351 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.193658 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.206853 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.220474 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.235407 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.250315 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:07:46.264625 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:07:46.392713 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:07:46.538190 tst switch_tch_pdch.py:51: start network... 14:07:46.768253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:47.247642 run create_hlr_db(pid=29681): Launched 14:07:47.385679 bus /gobi_6: Setting Powered False 14:07:48.448747 run create_hlr_db(pid=29681): Terminated: ok {rc=0} 14:07:48.875614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29683): Launched 14:07:49.175250 run osmo-hlr_10.42.42.2(pid=29684): Launched 14:07:49.287373 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:49.799411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29686): Launched 14:07:50.095876 run osmo-stp_10.42.42.5(pid=29687): Launched 14:07:50.208451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:07:50.719823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29689): Launched 14:07:50.833121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:07:51.083972 run patchelf(pid=29690): Launched 14:07:51.248729 run osmo-stp_10.42.42.5(pid=29687): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29687)] 14:07:51.374053 run osmo-stp_10.42.42.5(pid=29687): stdout: | (launched: 2022-12-13_14:07:50.040090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:51.500776 run osmo-stp_10.42.42.5(pid=29687): stderr: | 20221213140750208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140750208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140750209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140750209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140750210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140750210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140750210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:51.627947 run osmo-stp_10.42.42.5(pid=29687): stdout: | (launched: 2022-12-13_14:07:50.040090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:51.749564 run osmo-stp_10.42.42.5(pid=29687): stderr: | 20221213140750208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140750208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140750209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140750209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140750210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140750210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140750210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:51.893751 run patchelf(pid=29690): Terminating (SIGINT) 14:07:52.061182 run patchelf(pid=29690): Terminated: ok {rc=0} 14:07:52.181567 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29687): Process ended prematurely: osmo-stp_10.42.42.5(pid=29687) [trial-2390↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29687)] [trial-2390↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:07:52.190644 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 14:07:52.217162 run osmo-hlr_10.42.42.2(pid=29684): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29684)] 14:07:52.264183 run osmo-hlr_10.42.42.2(pid=29684): stdout: | (launched: 2022-12-13_14:07:49.118362) 14:07:52.313255 run osmo-hlr_10.42.42.2(pid=29684): stderr: | 20221213140749290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140749291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140749291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140749291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140749291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140749291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140749303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140749312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140749312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140749312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:52.362548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29683): Terminating (SIGTERM) 14:07:52.402291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29686): Terminating (SIGTERM) 14:07:52.441828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29689): Terminating (SIGTERM) 14:07:52.481644 --- ParallelTerminationStrategy: PID 29683 died... 14:07:52.500825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29683): Terminated: ok {rc=0} 14:07:52.544543 --- ParallelTerminationStrategy: PID 29686 died... 14:07:52.563362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29686): Terminated: ok {rc=0} 14:07:52.606769 --- ParallelTerminationStrategy: PID 29689 died... 14:07:52.625299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29689): Terminated: ok {rc=0} 14:07:52.710342 bus /gobi_0: Setting Powered False 14:07:53.808581 bus /gobi_0: Setting Powered False 14:07:54.922841 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 sms:nanobts+band-900 --------------------------------------------------------------------- 14:07:56.174292 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:56.180205 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:07:56.213097 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 14:07:56.241048 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 14:07:56.292869 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:07:56.324696 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 14:07:56.351303 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 14:07:56.901607 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 14:07:56.907732 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:56.918776 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 14:07:56.965141 tst mo_mt_sms.py: using LAC 34467 14:07:57.082215 tst mo_mt_sms.py: using RAC 42 14:07:57.199952 tst mo_mt_sms.py: using CellId 34467 14:07:57.317769 tst mo_mt_sms.py: using BVCI 34468 14:07:57.435698 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:57.447192 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:57.458407 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:57.469745 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:57.481242 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:07:57.492584 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 14:07:57.608733 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 14:07:57.727830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:58.219083 run create_hlr_db(pid=29695): Launched 14:07:58.341066 bus /gobi_6: Setting Powered False 14:07:59.404003 run create_hlr_db(pid=29695): Terminated: ok {rc=0} 14:07:59.830537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Launched 14:08:00.127096 run osmo-hlr_10.42.42.2(pid=29698): Launched 14:08:00.241274 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:00.751557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Launched 14:08:01.079932 run osmo-stp_10.42.42.5(pid=29701): Launched 14:08:01.385272 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:02.008114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Launched 14:08:02.329662 run osmo-msc_10.42.42.6(pid=29704): Launched 14:08:02.503265 run osmo-stp_10.42.42.5(pid=29701): ERR: Terminated: ERROR {rc=1} [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] 14:08:02.630758 run osmo-stp_10.42.42.5(pid=29701): stdout: | (launched: 2022-12-13_14:08:01.014584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:02.759916 run osmo-stp_10.42.42.5(pid=29701): stderr: | 20221213140801294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140801294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140801295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140801297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140801299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140801299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140801299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:02.886446 run osmo-stp_10.42.42.5(pid=29701): stdout: | (launched: 2022-12-13_14:08:01.014584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:03.006521 run osmo-stp_10.42.42.5(pid=29701): stderr: | 20221213140801294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140801294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140801295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140801297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140801299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140801299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140801299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:03.150840 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29701): Process ended prematurely: osmo-stp_10.42.42.5(pid=29701) [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py:16] 14:08:03.159306 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 14:08:03.185522 run osmo-hlr_10.42.42.2(pid=29698): ERR: Terminated: ERROR {rc=237} [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29698)] 14:08:03.233368 run osmo-hlr_10.42.42.2(pid=29698): stdout: | (launched: 2022-12-13_14:08:00.071846) 14:08:03.282476 run osmo-hlr_10.42.42.2(pid=29698): stderr: | 20221213140800242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140800243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140800243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140800243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140800243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140800243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140800255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140800263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140800263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140800263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:03.351095 run osmo-msc_10.42.42.6(pid=29704): ERR: Terminated: ERROR {rc=2} [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29704)] 14:08:03.398518 run osmo-msc_10.42.42.6(pid=29704): stdout: | (launched: 2022-12-13_14:08:02.271041) 14:08:03.447473 run osmo-msc_10.42.42.6(pid=29704): stderr: | 20221213140802548 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140802548 DLGLOBAL DEBUG validating counter group 0x7f653fe01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140802549 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140802549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140802549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140802549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140802551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140802551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140802551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140802551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:03.496775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Terminating (SIGTERM) 14:08:03.536364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Terminating (SIGTERM) 14:08:03.576641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Terminating (SIGTERM) 14:08:03.616895 --- ParallelTerminationStrategy: PID 29697 died... 14:08:03.636266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29697): Terminated: ok {rc=0} 14:08:03.680359 --- ParallelTerminationStrategy: PID 29700 died... 14:08:03.699273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29700): Terminated: ok {rc=0} 14:08:03.743177 --- ParallelTerminationStrategy: PID 29703 died... 14:08:03.762527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29703): Terminated: ok {rc=0} 14:08:03.849996 bus /sierra_3: Setting Powered False 14:08:04.949362 bus /sierra_3: Setting Powered False 14:08:06.063486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 14:08:07.302035 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:07.307286 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:08:07.340446 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 14:08:07.349241 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 14:08:07.389198 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:08:07.422649 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 14:08:07.429858 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 14:08:07.946977 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 14:08:07.952390 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 14:08:07.963666 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 14:08:08.015779 tst assert_extension.py: using LAC 34468 14:08:08.145315 tst assert_extension.py: using RAC 43 14:08:08.270361 tst assert_extension.py: using CellId 34468 14:08:08.394525 tst assert_extension.py: using BVCI 34469 14:08:08.511336 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 14:08:08.627902 tst assert_extension.py:10: start nitb and bts... 14:08:08.829998 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:08:09.447298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29709): Launched 14:08:09.748237 run osmo-nitb_10.42.42.2(pid=29710): Launched 14:08:09.915434 run osmo-nitb_10.42.42.2(pid=29710): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29710)] 14:08:10.050415 run osmo-nitb_10.42.42.2(pid=29710): stdout: | (launched: 2022-12-13_14:08:09.692114) 14:08:10.187427 run osmo-nitb_10.42.42.2(pid=29710): stderr: | (launched: 2022-12-13_14:08:09.736882) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:08:10.323547 run osmo-nitb_10.42.42.2(pid=29710): stdout: | (launched: 2022-12-13_14:08:09.692114) 14:08:10.454434 run osmo-nitb_10.42.42.2(pid=29710): stderr: | (launched: 2022-12-13_14:08:09.736882) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29710) [trial-2390↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29710)] 14:08:10.861825 tst osmo-nitb_10.42.42.2(pid=29710): stdout: | (launched: 2022-12-13_14:08:09.692114) 14:08:10.983228 tst osmo-nitb_10.42.42.2(pid=29710): stderr: | (launched: 2022-12-13_14:08:09.736882) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:08:11.126115 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29710) [trial-2390↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29710)] [trial-2390↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 14:08:11.134488 tst assert_extension.py:12: Test FAILED (3.2 sec) 14:08:11.141061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29709): Terminating (SIGTERM) 14:08:11.349585 --- ParallelTerminationStrategy: PID 29709 died... 14:08:11.370581 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29709): Terminated: ok {rc=0} 14:08:11.457731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 ussd:nanobts+band-900 --------------------------------------------------------------------- 14:08:12.638888 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:12.644189 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:08:12.677119 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 14:08:12.705935 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 14:08:12.742336 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:08:12.775413 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 14:08:12.803165 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 14:08:13.332252 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 14:08:13.337827 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.349254 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 14:08:13.397287 tst assert_extension.py: using LAC 34469 14:08:13.523647 tst assert_extension.py: using RAC 44 14:08:13.650628 tst assert_extension.py: using CellId 34469 14:08:13.778147 tst assert_extension.py: using BVCI 34470 14:08:13.895099 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.906360 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.917526 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.928387 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.939992 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:08:13.951481 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 14:08:14.067332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:14.535629 run create_hlr_db(pid=29715): Launched 14:08:14.659406 bus /sierra_2: Setting Powered False 14:08:15.719319 run create_hlr_db(pid=29715): Terminated: ok {rc=0} 14:08:16.163236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29717): Launched 14:08:16.484038 run osmo-hlr_10.42.42.2(pid=29718): Launched 14:08:16.780107 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:17.305401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29720): Launched 14:08:17.635286 run osmo-stp_10.42.42.5(pid=29721): Launched 14:08:17.759064 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:18.340831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29723): Launched 14:08:18.663224 run osmo-msc_10.42.42.6(pid=29724): Launched 14:08:18.847342 run osmo-stp_10.42.42.5(pid=29721): ERR: Terminated: ERROR {rc=1} [trial-2390↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29721)] 14:08:18.983924 run osmo-stp_10.42.42.5(pid=29721): stdout: | (launched: 2022-12-13_14:08:17.575175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:19.121905 run osmo-stp_10.42.42.5(pid=29721): stderr: | 20221213140817763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140817763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140817763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140817764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140817764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140817764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140817764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:19.256934 run osmo-stp_10.42.42.5(pid=29721): stdout: | (launched: 2022-12-13_14:08:17.575175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:19.384818 run osmo-stp_10.42.42.5(pid=29721): stderr: | 20221213140817763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140817763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140817763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140817764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140817764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140817764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140817764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:19.537893 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29721): Process ended prematurely: osmo-stp_10.42.42.5(pid=29721) [trial-2390↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29721)] [trial-2390↪ussd:nanobts+band-900↪assert_extension.py:17] 14:08:19.547104 tst assert_extension.py:17: Test FAILED (6.2 sec) 14:08:19.574677 run osmo-hlr_10.42.42.2(pid=29718): ERR: Terminated: ERROR {rc=237} [trial-2390↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29718)] 14:08:19.625535 run osmo-hlr_10.42.42.2(pid=29718): stdout: | (launched: 2022-12-13_14:08:16.424675) 14:08:19.677666 run osmo-hlr_10.42.42.2(pid=29718): stderr: | 20221213140816622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140816623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140816623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140816623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140816623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140816623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140816652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140816673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140816673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140816673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:19.749999 run osmo-msc_10.42.42.6(pid=29724): ERR: Terminated: ERROR {rc=2} [trial-2390↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29724)] 14:08:19.799582 run osmo-msc_10.42.42.6(pid=29724): stdout: | (launched: 2022-12-13_14:08:18.603028) 14:08:19.851681 run osmo-msc_10.42.42.6(pid=29724): stderr: | 20221213140818920 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140818921 DLGLOBAL DEBUG validating counter group 0x7f17bed1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140818921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140818921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140818921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140818921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140818923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140818923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140818923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140818923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:19.904288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29717): Terminating (SIGTERM) 14:08:19.945944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29720): Terminating (SIGTERM) 14:08:19.988073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29723): Terminating (SIGTERM) 14:08:20.030461 --- ParallelTerminationStrategy: PID 29717 died... 14:08:20.051059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29717): Terminated: ok {rc=0} 14:08:20.098194 --- ParallelTerminationStrategy: PID 29720 died... 14:08:20.118299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29720): Terminated: ok {rc=0} 14:08:20.164829 --- ParallelTerminationStrategy: PID 29723 died... 14:08:20.185266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29723): Terminated: ok {rc=0} 14:08:20.274191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:08:21.486752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:21.495109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:08:21.529435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:08:21.557817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:08:21.612368 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:08:21.645260 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:08:21.673164 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:08:22.226642 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:08:22.282056 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.293888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:08:22.367965 tst mo_mt_call.py: using LAC 34470 14:08:22.496364 tst mo_mt_call.py: using RAC 45 14:08:22.623940 tst mo_mt_call.py: using CellId 34470 14:08:22.751236 tst mo_mt_call.py: using BVCI 34471 14:08:22.870596 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.882313 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.893876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.905430 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.917819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:22.930108 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:08:23.050909 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:08:23.173708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:23.680218 run create_hlr_db(pid=29729): Launched 14:08:23.806605 bus /sierra_2: Setting Powered False 14:08:24.871267 run create_hlr_db(pid=29729): Terminated: ok {rc=0} 14:08:25.308758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29731): Launched 14:08:25.616813 run osmo-hlr_10.42.42.2(pid=29732): Launched 14:08:25.734011 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:26.262899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29734): Launched 14:08:26.570858 run osmo-stp_10.42.42.5(pid=29735): Launched 14:08:26.688423 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:27.242017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29737): Launched 14:08:27.551130 run osmo-msc_10.42.42.6(pid=29738): Launched 14:08:27.725309 run osmo-stp_10.42.42.5(pid=29735): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29735)] 14:08:27.855689 run osmo-stp_10.42.42.5(pid=29735): stdout: | (launched: 2022-12-13_14:08:26.512756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:27.985901 run osmo-stp_10.42.42.5(pid=29735): stderr: | 20221213140826683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140826683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140826683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140826684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140826684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140826684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140826685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:28.113213 run osmo-stp_10.42.42.5(pid=29735): stdout: | (launched: 2022-12-13_14:08:26.512756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:28.233915 run osmo-stp_10.42.42.5(pid=29735): stderr: | 20221213140826683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140826683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140826683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140826684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140826684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140826684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140826685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:28.378562 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29735): Process ended prematurely: osmo-stp_10.42.42.5(pid=29735) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29735)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:08:28.387491 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:08:28.414183 run osmo-hlr_10.42.42.2(pid=29732): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29732)] 14:08:28.461856 run osmo-hlr_10.42.42.2(pid=29732): stdout: | (launched: 2022-12-13_14:08:25.559717) 14:08:28.510897 run osmo-hlr_10.42.42.2(pid=29732): stderr: | 20221213140825734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140825734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140825734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140825734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140825734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140825734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140825787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140825796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140825796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140825796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:28.579870 run osmo-msc_10.42.42.6(pid=29738): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29738)] 14:08:28.627063 run osmo-msc_10.42.42.6(pid=29738): stdout: | (launched: 2022-12-13_14:08:27.493855) 14:08:28.676343 run osmo-msc_10.42.42.6(pid=29738): stderr: | 20221213140827764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140827764 DLGLOBAL DEBUG validating counter group 0x7f035b49ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140827764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140827764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140827764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140827765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140827766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140827767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140827767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140827767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:28.725741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29731): Terminating (SIGTERM) 14:08:28.765183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29734): Terminating (SIGTERM) 14:08:28.804562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29737): Terminating (SIGTERM) 14:08:28.844323 --- ParallelTerminationStrategy: PID 29731 died... 14:08:28.863509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29731): Terminated: ok {rc=0} 14:08:28.907380 --- ParallelTerminationStrategy: PID 29734 died... 14:08:28.926188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29734): Terminated: ok {rc=0} 14:08:28.969893 --- ParallelTerminationStrategy: PID 29737 died... 14:08:28.988245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29737): Terminated: ok {rc=0} 14:08:29.072885 bus /sierra_3: Setting Powered False 14:08:30.170916 bus /sierra_3: Setting Powered False 14:08:31.295669 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:08:32.462854 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:32.475422 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:08:32.545220 tst mo_mt_call_osmux.py: using LAC 34471 14:08:32.674912 tst mo_mt_call_osmux.py: using RAC 46 14:08:32.805245 tst mo_mt_call_osmux.py: using CellId 34471 14:08:32.934051 tst mo_mt_call_osmux.py: using BVCI 34472 14:08:33.054447 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:33.066373 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:33.078268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:33.090285 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:33.102505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:08:33.114380 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:08:33.234191 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:08:33.353928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:33.832638 run create_hlr_db(pid=29740): Launched 14:08:33.958838 bus /sierra_2: Setting Powered False 14:08:35.020328 run create_hlr_db(pid=29740): Terminated: ok {rc=0} 14:08:35.468627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29742): Launched 14:08:35.799923 run osmo-hlr_10.42.42.2(pid=29743): Launched 14:08:35.926671 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:36.496357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29745): Launched 14:08:36.826997 run osmo-stp_10.42.42.5(pid=29746): Launched 14:08:36.954680 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:37.549509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29748): Launched 14:08:37.864548 run osmo-msc_10.42.42.6(pid=29749): Launched 14:08:38.036585 run osmo-stp_10.42.42.5(pid=29746): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29746)] 14:08:38.166399 run osmo-stp_10.42.42.5(pid=29746): stdout: | (launched: 2022-12-13_14:08:36.765682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:38.295818 run osmo-stp_10.42.42.5(pid=29746): stderr: | 20221213140836955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140836955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140836955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140836956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140836956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140836956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140836956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:38.423929 run osmo-stp_10.42.42.5(pid=29746): stdout: | (launched: 2022-12-13_14:08:36.765682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:38.545454 run osmo-stp_10.42.42.5(pid=29746): stderr: | 20221213140836955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140836955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140836955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140836956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140836956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140836956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140836956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:38.691676 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29746): Process ended prematurely: osmo-stp_10.42.42.5(pid=29746) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29746)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:08:38.700799 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:08:38.727610 run osmo-hlr_10.42.42.2(pid=29743): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29743)] 14:08:38.776024 run osmo-hlr_10.42.42.2(pid=29743): stdout: | (launched: 2022-12-13_14:08:35.739066) 14:08:38.825784 run osmo-hlr_10.42.42.2(pid=29743): stderr: | 20221213140835936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140835936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140835936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140835936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140835936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140835936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140835949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140835958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140835959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140835959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:38.894807 run osmo-msc_10.42.42.6(pid=29749): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29749)] 14:08:38.942162 run osmo-msc_10.42.42.6(pid=29749): stdout: | (launched: 2022-12-13_14:08:37.807238) 14:08:38.991243 run osmo-msc_10.42.42.6(pid=29749): stderr: | 20221213140838078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140838078 DLGLOBAL DEBUG validating counter group 0x7efcbe392c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140838078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140838078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140838078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140838079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140838080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140838081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140838081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140838081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:39.040768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29742): Terminating (SIGTERM) 14:08:39.081165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29745): Terminating (SIGTERM) 14:08:39.121164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29748): Terminating (SIGTERM) 14:08:39.161626 --- ParallelTerminationStrategy: PID 29742 died... 14:08:39.181187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29742): Terminated: ok {rc=0} 14:08:39.225629 --- ParallelTerminationStrategy: PID 29745 died... 14:08:39.244265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29745): Terminated: ok {rc=0} 14:08:39.288543 --- ParallelTerminationStrategy: PID 29748 died... 14:08:39.307467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29748): Terminated: ok {rc=0} 14:08:39.391560 bus /sierra_3: Setting Powered False 14:08:40.489737 bus /sierra_3: Setting Powered False 14:08:41.606324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:08:42.857018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:42.864363 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:08:42.896079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:08:42.923651 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:08:42.975236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:08:43.007560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:08:43.034832 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:08:43.590117 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:08:43.644195 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:43.655972 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:08:43.724245 tst mo_mt_call.py: using LAC 34472 14:08:43.852697 tst mo_mt_call.py: using RAC 47 14:08:43.974700 tst mo_mt_call.py: using CellId 34472 14:08:44.094339 tst mo_mt_call.py: using BVCI 34473 14:08:44.206776 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:44.218017 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:44.229105 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:44.240091 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:44.251103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:44.262094 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:08:44.382415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:08:44.500812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:44.977197 run create_hlr_db(pid=29754): Launched 14:08:45.102958 bus /sierra_2: Setting Powered False 14:08:46.163217 run create_hlr_db(pid=29754): Terminated: ok {rc=0} 14:08:46.598490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Launched 14:08:46.927531 run osmo-hlr_10.42.42.2(pid=29766): Launched 14:08:47.208444 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:47.952273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Launched 14:08:48.393718 run osmo-stp_10.42.42.5(pid=29860): Launched 14:08:48.683525 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:49.514772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30006): Launched 14:08:49.932494 run osmo-msc_10.42.42.6(pid=30032): Launched 14:08:50.290436 run osmo-stp_10.42.42.5(pid=29860): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29860)] 14:08:50.562483 run osmo-stp_10.42.42.5(pid=29860): stdout: | (launched: 2022-12-13_14:08:48.321363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:50.849006 run osmo-stp_10.42.42.5(pid=29860): stderr: | 20221213140848696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140848696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140848705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140848705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140848706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140848706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140848706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:50.978888 run osmo-stp_10.42.42.5(pid=29860): stdout: | (launched: 2022-12-13_14:08:48.321363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:51.102425 run osmo-stp_10.42.42.5(pid=29860): stderr: | 20221213140848696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140848696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140848705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140848705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140848706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140848706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140848706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:51.250304 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29860): Process ended prematurely: osmo-stp_10.42.42.5(pid=29860) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29860)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:08:51.260536 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 14:08:51.288775 run osmo-hlr_10.42.42.2(pid=29766): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29766)] 14:08:51.338822 run osmo-hlr_10.42.42.2(pid=29766): stdout: | (launched: 2022-12-13_14:08:46.856030) 14:08:51.390469 run osmo-hlr_10.42.42.2(pid=29766): stderr: | 20221213140847170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140847170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140847171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140847171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140847171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140847171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140847186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140847196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140847196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140847196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:51.462780 run osmo-msc_10.42.42.6(pid=30032): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30032)] 14:08:51.512651 run osmo-msc_10.42.42.6(pid=30032): stdout: | (launched: 2022-12-13_14:08:49.858214) 14:08:51.564154 run osmo-msc_10.42.42.6(pid=30032): stderr: | 20221213140850447 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140850447 DLGLOBAL DEBUG validating counter group 0x7fde86fbdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140850447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140850447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140850447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140850448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140850454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140850454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140850454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140850454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:51.615014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Terminating (SIGTERM) 14:08:51.656490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Terminating (SIGTERM) 14:08:51.700409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30006): Terminating (SIGTERM) 14:08:51.744518 --- ParallelTerminationStrategy: PID 29756 died... 14:08:51.765053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Terminated: ok {rc=0} 14:08:51.811918 --- ParallelTerminationStrategy: PID 29808 died... 14:08:51.831513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Terminated: ok {rc=0} 14:08:51.876545 --- ParallelTerminationStrategy: PID 30006 died... 14:08:51.895987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30006): Terminated: ok {rc=0} 14:08:51.982392 bus /sierra_3: Setting Powered False 14:08:53.082774 bus /sierra_3: Setting Powered False 14:08:54.202111 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:08:55.352336 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.365842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:08:55.435341 tst mo_mt_call_osmux.py: using LAC 34473 14:08:55.558052 tst mo_mt_call_osmux.py: using RAC 48 14:08:55.686141 tst mo_mt_call_osmux.py: using CellId 34473 14:08:55.810387 tst mo_mt_call_osmux.py: using BVCI 34474 14:08:55.927081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.939310 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.951588 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.964047 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.976424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:08:55.989769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:08:56.112678 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:08:56.236659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:56.730296 run create_hlr_db(pid=30037): Launched 14:08:56.896504 bus /sierra_2: Setting Powered False 14:08:57.958703 run create_hlr_db(pid=30037): Terminated: ok {rc=0} 14:08:58.401901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Launched 14:08:58.734630 run osmo-hlr_10.42.42.2(pid=30040): Launched 14:08:58.972121 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:59.694745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Launched 14:09:00.030007 run osmo-stp_10.42.42.5(pid=30043): Launched 14:09:00.279261 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:01.004718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Launched 14:09:01.374383 run osmo-msc_10.42.42.6(pid=30046): Launched 14:09:01.773810 run osmo-stp_10.42.42.5(pid=30043): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] 14:09:01.926262 run osmo-stp_10.42.42.5(pid=30043): stdout: | (launched: 2022-12-13_14:08:59.966354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:02.205451 run osmo-stp_10.42.42.5(pid=30043): stderr: | 20221213140900295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140900295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140900295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140900296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140900296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140900296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140900296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:02.346682 run osmo-stp_10.42.42.5(pid=30043): stdout: | (launched: 2022-12-13_14:08:59.966354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:02.472436 run osmo-stp_10.42.42.5(pid=30043): stderr: | 20221213140900295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140900295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140900295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140900296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140900296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140900296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140900296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:02.623237 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30043): Process ended prematurely: osmo-stp_10.42.42.5(pid=30043) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:09:02.632889 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 14:09:02.660732 run osmo-hlr_10.42.42.2(pid=30040): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30040)] 14:09:02.711421 run osmo-hlr_10.42.42.2(pid=30040): stdout: | (launched: 2022-12-13_14:08:58.675518) 14:09:02.761969 run osmo-hlr_10.42.42.2(pid=30040): stderr: | 20221213140859011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140859012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140859012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140859012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140859012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140859012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140859030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140859038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140859039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140859039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:02.835636 run osmo-msc_10.42.42.6(pid=30046): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30046)] 14:09:02.884640 run osmo-msc_10.42.42.6(pid=30046): stdout: | (launched: 2022-12-13_14:09:01.309168) 14:09:02.935691 run osmo-msc_10.42.42.6(pid=30046): stderr: | 20221213140901853 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140901853 DLGLOBAL DEBUG validating counter group 0x7f6133dd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140901853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140901853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140901854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140901854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140901856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140901856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140901856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140901856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:02.986116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Terminating (SIGTERM) 14:09:03.029035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Terminating (SIGTERM) 14:09:03.072174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Terminating (SIGTERM) 14:09:03.115128 --- ParallelTerminationStrategy: PID 30039 died... 14:09:03.134879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Terminated: ok {rc=0} 14:09:03.180589 --- ParallelTerminationStrategy: PID 30042 died... 14:09:03.199972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Terminated: ok {rc=0} 14:09:03.245639 --- ParallelTerminationStrategy: PID 30045 died... 14:09:03.264706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Terminated: ok {rc=0} 14:09:03.353493 bus /sierra_3: Setting Powered False 14:09:04.454417 bus /sierra_3: Setting Powered False 14:09:05.570107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:09:06.834665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:06.844036 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:09:06.881227 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:09:06.911169 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:09:06.966770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:09:07.001614 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:09:07.032338 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:09:07.583162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:09:07.641770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:07.654776 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:09:07.728616 tst mo_mt_call.py: using LAC 34474 14:09:07.863556 tst mo_mt_call.py: using RAC 49 14:09:08.000667 tst mo_mt_call.py: using CellId 34474 14:09:08.134527 tst mo_mt_call.py: using BVCI 34475 14:09:08.260437 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:08.273540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:08.286715 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:08.299504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:08.313469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:08.344353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:09:08.593189 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:09:08.711252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:09.198054 run create_hlr_db(pid=30055): Launched 14:09:09.362256 bus /sierra_2: Setting Powered False 14:09:10.425565 run create_hlr_db(pid=30055): Terminated: ok {rc=0} 14:09:10.870056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Launched 14:09:11.179110 run osmo-hlr_10.42.42.2(pid=30058): Launched 14:09:11.296889 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:11.830436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Launched 14:09:12.138521 run osmo-stp_10.42.42.5(pid=30061): Launched 14:09:12.256646 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:12.811108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Launched 14:09:13.121149 run osmo-msc_10.42.42.6(pid=30064): Launched 14:09:13.292000 run osmo-stp_10.42.42.5(pid=30061): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] 14:09:13.421163 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-13_14:09:12.080295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:13.550790 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221213140912251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140912251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140912251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140912251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140912252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140912252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140912252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:13.678606 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-13_14:09:12.080295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:13.800429 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221213140912251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140912251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140912251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140912251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140912252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140912252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140912252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:13.946319 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30061): Process ended prematurely: osmo-stp_10.42.42.5(pid=30061) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:09:13.955443 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:09:13.982360 run osmo-hlr_10.42.42.2(pid=30058): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30058)] 14:09:14.030096 run osmo-hlr_10.42.42.2(pid=30058): stdout: | (launched: 2022-12-13_14:09:11.121405) 14:09:14.079175 run osmo-hlr_10.42.42.2(pid=30058): stderr: | 20221213140911298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140911298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140911298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140911298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140911298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140911298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140911310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140911319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140911319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140911319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:14.148193 run osmo-msc_10.42.42.6(pid=30064): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30064)] 14:09:14.195347 run osmo-msc_10.42.42.6(pid=30064): stdout: | (launched: 2022-12-13_14:09:13.062962) 14:09:14.244098 run osmo-msc_10.42.42.6(pid=30064): stderr: | 20221213140913337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140913337 DLGLOBAL DEBUG validating counter group 0x7f409ca75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140913337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140913337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140913337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140913337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140913339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140913340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140913340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140913340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:14.293297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Terminating (SIGTERM) 14:09:14.333078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminating (SIGTERM) 14:09:14.373563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Terminating (SIGTERM) 14:09:14.413703 --- ParallelTerminationStrategy: PID 30057 died... 14:09:14.433045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Terminated: ok {rc=0} 14:09:14.477153 --- ParallelTerminationStrategy: PID 30060 died... 14:09:14.495830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminated: ok {rc=0} 14:09:14.539625 --- ParallelTerminationStrategy: PID 30063 died... 14:09:14.558301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30063): Terminated: ok {rc=0} 14:09:14.644111 bus /sierra_3: Setting Powered False 14:09:15.742947 bus /sierra_3: Setting Powered False 14:09:16.862978 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:09:18.027372 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.039994 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:09:18.118400 tst mo_mt_call_osmux.py: using LAC 34475 14:09:18.257097 tst mo_mt_call_osmux.py: using RAC 50 14:09:18.386307 tst mo_mt_call_osmux.py: using CellId 34475 14:09:18.513652 tst mo_mt_call_osmux.py: using BVCI 34476 14:09:18.627139 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.638757 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.650099 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.661404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.672772 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:09:18.684043 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:09:18.800091 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:09:18.925449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:19.404114 run create_hlr_db(pid=30067): Launched 14:09:19.532022 bus /sierra_2: Setting Powered False 14:09:20.594014 run create_hlr_db(pid=30067): Terminated: ok {rc=0} 14:09:21.042288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Launched 14:09:21.374453 run osmo-hlr_10.42.42.2(pid=30070): Launched 14:09:21.502155 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:22.069407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Launched 14:09:22.402930 run osmo-stp_10.42.42.5(pid=30073): Launched 14:09:22.529258 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:23.122369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Launched 14:09:23.455332 run osmo-msc_10.42.42.6(pid=30076): Launched 14:09:23.638489 run osmo-stp_10.42.42.5(pid=30073): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] 14:09:23.776921 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-13_14:09:22.341600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:23.916184 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221213140922534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140922534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140922534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140922534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140922535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140922535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140922535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:24.053659 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-13_14:09:22.341600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:24.184675 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221213140922534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140922534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140922534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140922534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140922535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140922535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140922535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:24.340827 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:09:24.350766 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:09:24.378588 run osmo-hlr_10.42.42.2(pid=30070): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30070)] 14:09:24.429569 run osmo-hlr_10.42.42.2(pid=30070): stdout: | (launched: 2022-12-13_14:09:21.313049) 14:09:24.481697 run osmo-hlr_10.42.42.2(pid=30070): stderr: | 20221213140921510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140921510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140921510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140921510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140921510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140921510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140921523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140921531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140921531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140921532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:24.554053 run osmo-msc_10.42.42.6(pid=30076): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30076)] 14:09:24.603542 run osmo-msc_10.42.42.6(pid=30076): stdout: | (launched: 2022-12-13_14:09:23.393626) 14:09:24.655469 run osmo-msc_10.42.42.6(pid=30076): stderr: | 20221213140923717 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140923718 DLGLOBAL DEBUG validating counter group 0x7f1519c3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140923718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140923718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140923718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140923718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140923720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140923720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140923720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140923720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:24.707465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminating (SIGTERM) 14:09:24.749506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminating (SIGTERM) 14:09:24.791494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Terminating (SIGTERM) 14:09:24.833887 --- ParallelTerminationStrategy: PID 30069 died... 14:09:24.854334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminated: ok {rc=0} 14:09:24.900733 --- ParallelTerminationStrategy: PID 30072 died... 14:09:24.920399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminated: ok {rc=0} 14:09:24.966905 --- ParallelTerminationStrategy: PID 30075 died... 14:09:24.987084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Terminated: ok {rc=0} 14:09:25.075603 bus /sierra_3: Setting Powered False 14:09:26.174645 bus /sierra_3: Setting Powered False 14:09:27.291548 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:09:28.544703 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:28.553035 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:09:28.586758 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:09:28.614395 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:09:28.667437 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:09:28.700231 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:09:28.727680 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:09:29.278936 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:09:29.328376 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.339805 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:09:29.406284 tst mo_mt_call.py: using LAC 34476 14:09:29.528669 tst mo_mt_call.py: using RAC 51 14:09:29.649158 tst mo_mt_call.py: using CellId 34476 14:09:29.771762 tst mo_mt_call.py: using BVCI 34477 14:09:29.885381 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.896517 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.907605 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.918604 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.929712 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:29.940777 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:09:30.056837 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:09:30.179487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:30.688911 run create_hlr_db(pid=30082): Launched 14:09:30.815669 bus /sierra_2: Setting Powered False 14:09:31.878398 run create_hlr_db(pid=30082): Terminated: ok {rc=0} 14:09:32.362853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Launched 14:09:32.695183 run osmo-hlr_10.42.42.2(pid=30085): Launched 14:09:32.821168 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:33.388320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Launched 14:09:33.719049 run osmo-stp_10.42.42.5(pid=30088): Launched 14:09:33.844869 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:34.440615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Launched 14:09:34.770612 run osmo-msc_10.42.42.6(pid=30091): Launched 14:09:34.955439 run osmo-stp_10.42.42.5(pid=30088): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] 14:09:35.093997 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-13_14:09:33.657569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:35.234031 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221213140933851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140933851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140933852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140933852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140933852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140933853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140933853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:35.371632 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-13_14:09:33.657569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:35.502567 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221213140933851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140933851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140933852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140933852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140933852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140933853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140933853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:35.658975 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:09:35.668494 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:09:35.696564 run osmo-hlr_10.42.42.2(pid=30085): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30085)] 14:09:35.747715 run osmo-hlr_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-13_14:09:32.634131) 14:09:35.799962 run osmo-hlr_10.42.42.2(pid=30085): stderr: | 20221213140932831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140932831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140932831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140932831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140932831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140932831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140932846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140932854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140932855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140932855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:35.873077 run osmo-msc_10.42.42.6(pid=30091): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30091)] 14:09:35.923609 run osmo-msc_10.42.42.6(pid=30091): stdout: | (launched: 2022-12-13_14:09:34.709543) 14:09:35.975879 run osmo-msc_10.42.42.6(pid=30091): stderr: | 20221213140935033 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140935033 DLGLOBAL DEBUG validating counter group 0x7f7709f60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140935033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140935033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140935033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140935034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140935035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140935036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140935036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140935036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:36.028266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminating (SIGTERM) 14:09:36.070197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminating (SIGTERM) 14:09:36.112543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminating (SIGTERM) 14:09:36.155648 --- ParallelTerminationStrategy: PID 30084 died... 14:09:36.176351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminated: ok {rc=0} 14:09:36.223147 --- ParallelTerminationStrategy: PID 30087 died... 14:09:36.243226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminated: ok {rc=0} 14:09:36.289814 --- ParallelTerminationStrategy: PID 30090 died... 14:09:36.309911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminated: ok {rc=0} 14:09:36.399189 bus /sierra_3: Setting Powered False 14:09:37.498819 bus /sierra_3: Setting Powered False 14:09:38.616597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:09:39.764448 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:39.776298 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:09:39.843639 tst mo_mt_call_osmux.py: using LAC 34477 14:09:39.964557 tst mo_mt_call_osmux.py: using RAC 52 14:09:40.090252 tst mo_mt_call_osmux.py: using CellId 34477 14:09:40.211545 tst mo_mt_call_osmux.py: using BVCI 34478 14:09:40.324014 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:40.335314 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:40.346560 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:40.357617 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:40.368694 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:09:40.379772 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:09:40.500585 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:09:40.619515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:41.098930 run create_hlr_db(pid=30093): Launched 14:09:41.227363 bus /sierra_2: Setting Powered False 14:09:42.289138 run create_hlr_db(pid=30093): Terminated: ok {rc=0} 14:09:42.737295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Launched 14:09:43.068340 run osmo-hlr_10.42.42.2(pid=30096): Launched 14:09:43.194009 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:43.759121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Launched 14:09:44.090352 run osmo-stp_10.42.42.5(pid=30099): Launched 14:09:44.215759 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:44.810297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Launched 14:09:45.141719 run osmo-msc_10.42.42.6(pid=30102): Launched 14:09:45.326050 run osmo-stp_10.42.42.5(pid=30099): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] 14:09:45.464541 run osmo-stp_10.42.42.5(pid=30099): stdout: | (launched: 2022-12-13_14:09:44.028860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:45.604640 run osmo-stp_10.42.42.5(pid=30099): stderr: | 20221213140944221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140944221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140944221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140944222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140944222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140944222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140944222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:45.742607 run osmo-stp_10.42.42.5(pid=30099): stdout: | (launched: 2022-12-13_14:09:44.028860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:45.878515 run osmo-stp_10.42.42.5(pid=30099): stderr: | 20221213140944221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140944221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140944221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140944222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140944222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140944222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140944222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:46.050919 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30099): Process ended prematurely: osmo-stp_10.42.42.5(pid=30099) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:09:46.061819 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:09:46.091155 run osmo-hlr_10.42.42.2(pid=30096): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30096)] 14:09:46.145225 run osmo-hlr_10.42.42.2(pid=30096): stdout: | (launched: 2022-12-13_14:09:43.007327) 14:09:46.199005 run osmo-hlr_10.42.42.2(pid=30096): stderr: | 20221213140943205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140943205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140943205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140943205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140943205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140943205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140943217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140943226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140943226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140943226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:46.273651 run osmo-msc_10.42.42.6(pid=30102): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30102)] 14:09:46.325853 run osmo-msc_10.42.42.6(pid=30102): stdout: | (launched: 2022-12-13_14:09:45.079854) 14:09:46.379611 run osmo-msc_10.42.42.6(pid=30102): stderr: | 20221213140945401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140945401 DLGLOBAL DEBUG validating counter group 0x7f6c50a4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140945401 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140945401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140945401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140945402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140945403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140945404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140945404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140945404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:46.433967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Terminating (SIGTERM) 14:09:46.477943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Terminating (SIGTERM) 14:09:46.524061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Terminating (SIGTERM) 14:09:46.570129 --- ParallelTerminationStrategy: PID 30095 died... 14:09:46.592138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Terminated: ok {rc=0} 14:09:46.641055 --- ParallelTerminationStrategy: PID 30098 died... 14:09:46.661644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Terminated: ok {rc=0} 14:09:46.710651 --- ParallelTerminationStrategy: PID 30101 died... 14:09:46.731220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Terminated: ok {rc=0} 14:09:46.824353 bus /sierra_3: Setting Powered False 14:09:47.924761 bus /sierra_3: Setting Powered False 14:09:49.043394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:09:50.296380 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:50.304877 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:09:50.339235 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:09:50.366985 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:09:50.419153 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:09:50.451363 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:09:50.477963 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:09:51.032231 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:09:51.081868 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.093286 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:09:51.159494 tst mo_mt_call.py: using LAC 34478 14:09:51.279157 tst mo_mt_call.py: using RAC 53 14:09:51.400828 tst mo_mt_call.py: using CellId 34478 14:09:51.519757 tst mo_mt_call.py: using BVCI 34479 14:09:51.633258 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.644456 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.655634 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.666799 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.678171 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:09:51.689515 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:09:51.805455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:09:51.927135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:52.404838 run create_hlr_db(pid=30107): Launched 14:09:52.531118 bus /sierra_2: Setting Powered False 14:09:53.591819 run create_hlr_db(pid=30107): Terminated: ok {rc=0} 14:09:54.041125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30109): Launched 14:09:54.373829 run osmo-hlr_10.42.42.2(pid=30110): Launched 14:09:54.499085 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:55.069098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30112): Launched 14:09:55.400177 run osmo-stp_10.42.42.5(pid=30113): Launched 14:09:55.526889 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:56.130743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30115): Launched 14:09:56.461036 run osmo-msc_10.42.42.6(pid=30116): Launched 14:09:56.644281 run osmo-stp_10.42.42.5(pid=30113): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30113)] 14:09:56.783091 run osmo-stp_10.42.42.5(pid=30113): stdout: | (launched: 2022-12-13_14:09:55.339044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:56.922610 run osmo-stp_10.42.42.5(pid=30113): stderr: | 20221213140955537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140955537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140955538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140955538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140955539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140955539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140955539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:57.059898 run osmo-stp_10.42.42.5(pid=30113): stdout: | (launched: 2022-12-13_14:09:55.339044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:57.191056 run osmo-stp_10.42.42.5(pid=30113): stderr: | 20221213140955537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213140955537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213140955538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213140955538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213140955539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213140955539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213140955539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:57.347193 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30113): Process ended prematurely: osmo-stp_10.42.42.5(pid=30113) [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30113)] [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:09:57.357131 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:09:57.385044 run osmo-hlr_10.42.42.2(pid=30110): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30110)] 14:09:57.436211 run osmo-hlr_10.42.42.2(pid=30110): stdout: | (launched: 2022-12-13_14:09:54.312393) 14:09:57.488461 run osmo-hlr_10.42.42.2(pid=30110): stderr: | 20221213140954511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213140954512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213140954512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213140954512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213140954512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213140954512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213140954528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213140954537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213140954537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213140954537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:57.561331 run osmo-msc_10.42.42.6(pid=30116): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30116)] 14:09:57.611359 run osmo-msc_10.42.42.6(pid=30116): stdout: | (launched: 2022-12-13_14:09:56.399153) 14:09:57.663520 run osmo-msc_10.42.42.6(pid=30116): stderr: | 20221213140956725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213140956725 DLGLOBAL DEBUG validating counter group 0x7f30d747bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213140956725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213140956725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213140956725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213140956725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213140956727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213140956727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213140956728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213140956728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:57.715870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30109): Terminating (SIGTERM) 14:09:57.757874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30112): Terminating (SIGTERM) 14:09:57.799873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30115): Terminating (SIGTERM) 14:09:57.842388 --- ParallelTerminationStrategy: PID 30109 died... 14:09:57.863073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30109): Terminated: ok {rc=0} 14:09:57.909761 --- ParallelTerminationStrategy: PID 30112 died... 14:09:57.929916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30112): Terminated: ok {rc=0} 14:09:57.976458 --- ParallelTerminationStrategy: PID 30115 died... 14:09:57.996380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30115): Terminated: ok {rc=0} 14:09:58.084766 bus /sierra_3: Setting Powered False 14:09:59.181784 bus /sierra_3: Setting Powered False 14:10:00.295506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:10:01.468274 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:01.482665 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:10:01.554898 tst mo_mt_call_osmux.py: using LAC 34479 14:10:01.686137 tst mo_mt_call_osmux.py: using RAC 54 14:10:01.847063 tst mo_mt_call_osmux.py: using CellId 34479 14:10:01.973197 tst mo_mt_call_osmux.py: using BVCI 34480 14:10:02.119370 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:02.132572 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:02.145507 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:02.158449 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:02.172124 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:10:02.186732 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:10:02.312542 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:10:02.433943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:02.912142 run create_hlr_db(pid=30121): Launched 14:10:03.038270 bus /sierra_2: Setting Powered False 14:10:04.099120 run create_hlr_db(pid=30121): Terminated: ok {rc=0} 14:10:04.546995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Launched 14:10:04.877323 run osmo-hlr_10.42.42.2(pid=30124): Launched 14:10:05.003269 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:05.566801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Launched 14:10:05.897057 run osmo-stp_10.42.42.5(pid=30127): Launched 14:10:06.023072 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:06.616183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Launched 14:10:06.947684 run osmo-msc_10.42.42.6(pid=30130): Launched 14:10:07.130798 run osmo-stp_10.42.42.5(pid=30127): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] 14:10:07.269140 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-13_14:10:05.835815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:07.407775 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221213141006027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141006027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141006028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141006028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141006028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141006029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141006029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:07.544583 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-13_14:10:05.835815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:07.674823 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221213141006027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141006027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141006028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141006028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141006028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141006029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141006029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:07.830838 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:10:07.840588 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:10:07.868674 run osmo-hlr_10.42.42.2(pid=30124): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30124)] 14:10:07.919543 run osmo-hlr_10.42.42.2(pid=30124): stdout: | (launched: 2022-12-13_14:10:04.816182) 14:10:07.971506 run osmo-hlr_10.42.42.2(pid=30124): stderr: | 20221213141005014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141005014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141005014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141005014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141005015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141005015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141005025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141005034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141005035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141005035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:08.043696 run osmo-msc_10.42.42.6(pid=30130): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30130)] 14:10:08.093339 run osmo-msc_10.42.42.6(pid=30130): stdout: | (launched: 2022-12-13_14:10:06.886101) 14:10:08.145851 run osmo-msc_10.42.42.6(pid=30130): stderr: | 20221213141007207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141007207 DLGLOBAL DEBUG validating counter group 0x7efcee9afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141007207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141007207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141007207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141007207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141007209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141007209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141007210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141007210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:08.198475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminating (SIGTERM) 14:10:08.240172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminating (SIGTERM) 14:10:08.282336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Terminating (SIGTERM) 14:10:08.325055 --- ParallelTerminationStrategy: PID 30123 died... 14:10:08.345773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminated: ok {rc=0} 14:10:08.392533 --- ParallelTerminationStrategy: PID 30126 died... 14:10:08.412683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminated: ok {rc=0} 14:10:08.461385 --- ParallelTerminationStrategy: PID 30129 died... 14:10:08.481379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Terminated: ok {rc=0} 14:10:08.568808 bus /sierra_3: Setting Powered False 14:10:09.667970 bus /sierra_3: Setting Powered False 14:10:10.783869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:10:12.043904 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:12.051909 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:10:12.085922 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 14:10:12.114059 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 14:10:12.169470 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:10:12.201664 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 14:10:12.228265 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 14:10:12.781131 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 14:10:12.830944 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:12.842551 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:10:12.892062 tst mo_mt_call.py: using LAC 34480 14:10:13.014404 tst mo_mt_call.py: using RAC 55 14:10:13.137095 tst mo_mt_call.py: using CellId 34480 14:10:13.263103 tst mo_mt_call.py: using BVCI 34481 14:10:13.375066 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:13.386723 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:13.398027 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:13.409232 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:13.420649 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:13.432202 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:10:13.552713 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:10:13.674018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:14.184940 run create_hlr_db(pid=30135): Launched 14:10:14.312621 bus /sierra_2: Setting Powered False 14:10:15.372879 run create_hlr_db(pid=30135): Terminated: ok {rc=0} 14:10:15.840375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Launched 14:10:16.191012 run osmo-hlr_10.42.42.2(pid=30138): Launched 14:10:16.441708 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:17.118841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Launched 14:10:17.463531 run osmo-stp_10.42.42.5(pid=30141): Launched 14:10:17.591677 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:18.185485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Launched 14:10:18.518253 run osmo-msc_10.42.42.6(pid=30144): Launched 14:10:18.703641 run osmo-stp_10.42.42.5(pid=30141): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] 14:10:18.842328 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-13_14:10:17.402225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:18.981641 run osmo-stp_10.42.42.5(pid=30141): stderr: | 20221213141017594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141017594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141017594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141017594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141017595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141017595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141017595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:19.119040 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-13_14:10:17.402225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:19.250210 run osmo-stp_10.42.42.5(pid=30141): stderr: | 20221213141017594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141017594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141017594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141017594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141017595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141017595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141017595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:19.406543 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 14:10:19.416372 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:10:19.444566 run osmo-hlr_10.42.42.2(pid=30138): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30138)] 14:10:19.495378 run osmo-hlr_10.42.42.2(pid=30138): stdout: | (launched: 2022-12-13_14:10:16.129588) 14:10:19.547733 run osmo-hlr_10.42.42.2(pid=30138): stderr: | 20221213141016439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141016439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141016439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141016439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141016439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141016439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141016454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141016462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141016462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141016462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:19.620188 run osmo-msc_10.42.42.6(pid=30144): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30144)] 14:10:19.670232 run osmo-msc_10.42.42.6(pid=30144): stdout: | (launched: 2022-12-13_14:10:18.456484) 14:10:19.722248 run osmo-msc_10.42.42.6(pid=30144): stderr: | 20221213141018778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141018778 DLGLOBAL DEBUG validating counter group 0x7fabf0b7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141018778 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141018778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141018779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141018779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141018780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141018781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141018781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141018781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:19.774551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminating (SIGTERM) 14:10:19.816231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminating (SIGTERM) 14:10:19.858367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminating (SIGTERM) 14:10:19.900645 --- ParallelTerminationStrategy: PID 30137 died... 14:10:19.921384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminated: ok {rc=0} 14:10:19.968050 --- ParallelTerminationStrategy: PID 30140 died... 14:10:19.988102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminated: ok {rc=0} 14:10:20.034504 --- ParallelTerminationStrategy: PID 30143 died... 14:10:20.054418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminated: ok {rc=0} 14:10:20.143155 bus /sierra_3: Setting Powered False 14:10:21.241812 bus /sierra_3: Setting Powered False 14:10:22.359331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 14:10:23.505670 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:23.517661 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:10:23.567411 tst mo_mt_call_osmux.py: using LAC 34481 14:10:23.689393 tst mo_mt_call_osmux.py: using RAC 56 14:10:23.808555 tst mo_mt_call_osmux.py: using CellId 34481 14:10:23.929386 tst mo_mt_call_osmux.py: using BVCI 34482 14:10:24.041262 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:24.052585 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:24.063927 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:24.075162 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:24.086750 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:10:24.098014 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:10:24.215135 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:10:24.337662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:24.847999 run create_hlr_db(pid=30146): Launched 14:10:24.976175 bus /sierra_2: Setting Powered False 14:10:26.041051 run create_hlr_db(pid=30146): Terminated: ok {rc=0} 14:10:26.481065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Launched 14:10:26.790501 run osmo-hlr_10.42.42.2(pid=30149): Launched 14:10:26.910274 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:27.439262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Launched 14:10:27.749097 run osmo-stp_10.42.42.5(pid=30152): Launched 14:10:27.866299 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:28.422397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Launched 14:10:28.732846 run osmo-msc_10.42.42.6(pid=30155): Launched 14:10:28.907344 run osmo-stp_10.42.42.5(pid=30152): ERR: Terminated: ERROR {rc=1} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] 14:10:29.038203 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-13_14:10:27.691178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:29.178893 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221213141027862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141027862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141027862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141027863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141027863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141027863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141027863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:29.307425 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-13_14:10:27.691178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:29.429597 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221213141027862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141027862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141027862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141027863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141027863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141027863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141027863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:29.576105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 14:10:29.585347 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 14:10:29.611988 run osmo-hlr_10.42.42.2(pid=30149): ERR: Terminated: ERROR {rc=237} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30149)] 14:10:29.659803 run osmo-hlr_10.42.42.2(pid=30149): stdout: | (launched: 2022-12-13_14:10:26.732467) 14:10:29.709138 run osmo-hlr_10.42.42.2(pid=30149): stderr: | 20221213141026911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141026911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141026911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141026911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141026911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141026911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141026923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141026933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141026934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141026934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:29.778270 run osmo-msc_10.42.42.6(pid=30155): ERR: Terminated: ERROR {rc=2} [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30155)] 14:10:29.825819 run osmo-msc_10.42.42.6(pid=30155): stdout: | (launched: 2022-12-13_14:10:28.674914) 14:10:29.874940 run osmo-msc_10.42.42.6(pid=30155): stderr: | 20221213141028948 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141028948 DLGLOBAL DEBUG validating counter group 0x7fbb3233fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141028948 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141028948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141028948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141028949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141028950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141028951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141028951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141028951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:29.925247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminating (SIGTERM) 14:10:29.965173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminating (SIGTERM) 14:10:30.004874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Terminating (SIGTERM) 14:10:30.044883 --- ParallelTerminationStrategy: PID 30148 died... 14:10:30.063901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminated: ok {rc=0} 14:10:30.108179 --- ParallelTerminationStrategy: PID 30151 died... 14:10:30.126987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminated: ok {rc=0} 14:10:30.171233 --- ParallelTerminationStrategy: PID 30154 died... 14:10:30.190138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Terminated: ok {rc=0} 14:10:30.276311 bus /sierra_3: Setting Powered False 14:10:31.375327 bus /sierra_3: Setting Powered False 14:10:32.491165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 emergency:nanobts+band-900 --------------------------------------------------------------------- 14:10:33.753020 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:33.759170 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:10:33.792572 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 14:10:33.821119 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 14:10:33.907395 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:10:33.939921 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 14:10:33.967251 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 14:10:34.554356 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2390 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 14:10:34.559580 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:34.570819 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 14:10:34.620249 tst emergency_mo_mt_call.py: using LAC 34482 14:10:34.746176 tst emergency_mo_mt_call.py: using RAC 57 14:10:34.871944 tst emergency_mo_mt_call.py: using CellId 34482 14:10:34.998037 tst emergency_mo_mt_call.py: using BVCI 34483 14:10:35.117087 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:35.128336 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:35.139464 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:35.151062 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:35.162503 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:35.173942 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:35.292603 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:35.412311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:35.912232 run create_hlr_db(pid=30162): Launched 14:10:36.036286 bus /sierra_2: Setting Powered False 14:10:37.097196 run create_hlr_db(pid=30162): Terminated: ok {rc=0} 14:10:37.549365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30164): Launched 14:10:37.874650 run osmo-hlr_10.42.42.2(pid=30165): Launched 14:10:37.999576 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:38.559124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30167): Launched 14:10:38.883194 run osmo-stp_10.42.42.5(pid=30168): Launched 14:10:39.017995 tst emergency_mo_mt_call.py: using MSISDN 8191 14:10:39.185447 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:39.766856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30170): Launched 14:10:40.090308 run osmo-msc_10.42.42.6(pid=30171): Launched 14:10:40.272557 run osmo-stp_10.42.42.5(pid=30168): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30168)] 14:10:40.408774 run osmo-stp_10.42.42.5(pid=30168): stdout: | (launched: 2022-12-13_14:10:38.822999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:40.545639 run osmo-stp_10.42.42.5(pid=30168): stderr: | 20221213141039015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141039015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141039015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141039016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141039017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141039017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141039017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:40.681281 run osmo-stp_10.42.42.5(pid=30168): stdout: | (launched: 2022-12-13_14:10:38.822999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:40.809498 run osmo-stp_10.42.42.5(pid=30168): stderr: | 20221213141039015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141039015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141039015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141039016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141039017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141039017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141039017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:40.962881 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30168): Process ended prematurely: osmo-stp_10.42.42.5(pid=30168) [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30168)] [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 14:10:40.972041 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 14:10:40.999735 run osmo-hlr_10.42.42.2(pid=30165): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30165)] 14:10:41.051197 run osmo-hlr_10.42.42.2(pid=30165): stdout: | (launched: 2022-12-13_14:10:37.814408) 14:10:41.103427 run osmo-hlr_10.42.42.2(pid=30165): stderr: | 20221213141038011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141038011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141038011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141038011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141038011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141038011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141038024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141038033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141038033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141038033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:41.176279 run osmo-msc_10.42.42.6(pid=30171): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30171)] 14:10:41.226277 run osmo-msc_10.42.42.6(pid=30171): stdout: | (launched: 2022-12-13_14:10:40.030108) 14:10:41.278647 run osmo-msc_10.42.42.6(pid=30171): stderr: | 20221213141040350 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141040350 DLGLOBAL DEBUG validating counter group 0x7ff1ede95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141040350 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141040350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141040350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141040350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141040352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141040352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141040352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141040353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:41.331234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30164): Terminating (SIGTERM) 14:10:41.373051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30167): Terminating (SIGTERM) 14:10:41.415229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30170): Terminating (SIGTERM) 14:10:41.457720 --- ParallelTerminationStrategy: PID 30164 died... 14:10:41.478147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30164): Terminated: ok {rc=0} 14:10:41.524733 --- ParallelTerminationStrategy: PID 30167 died... 14:10:41.544611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30167): Terminated: ok {rc=0} 14:10:41.591120 --- ParallelTerminationStrategy: PID 30170 died... 14:10:41.611027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30170): Terminated: ok {rc=0} 14:10:41.698831 bus /sierra_3: Setting Powered False 14:10:42.796859 bus /sierra_3: Setting Powered False 14:10:43.912733 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 14:10:44.998465 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.010289 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 14:10:45.060216 tst emergency_preemptive_call.py: using LAC 34483 14:10:45.179122 tst emergency_preemptive_call.py: using RAC 58 14:10:45.298213 tst emergency_preemptive_call.py: using CellId 34483 14:10:45.417437 tst emergency_preemptive_call.py: using BVCI 34484 14:10:45.525628 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.536382 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.547017 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.557571 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.568353 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:10:45.579028 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:45.693551 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:45.810324 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:45.945397 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:10:46.068827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:46.646512 run create_hlr_db(pid=30173): Launched 14:10:46.803645 bus /sierra_2: Setting Powered False 14:10:47.867631 run create_hlr_db(pid=30173): Terminated: ok {rc=0} 14:10:48.303977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30175): Launched 14:10:48.608169 run osmo-hlr_10.42.42.2(pid=30176): Launched 14:10:48.725945 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:49.250694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30178): Launched 14:10:49.552344 run osmo-stp_10.42.42.5(pid=30179): Launched 14:10:49.678814 tst emergency_preemptive_call.py: using MSISDN 8192 14:10:49.831746 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:50.374672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30181): Launched 14:10:50.678086 run osmo-msc_10.42.42.6(pid=30182): Launched 14:10:50.847739 run osmo-stp_10.42.42.5(pid=30179): ERR: Terminated: ERROR {rc=1} [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30179)] 14:10:50.974959 run osmo-stp_10.42.42.5(pid=30179): stdout: | (launched: 2022-12-13_14:10:49.495739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:51.102880 run osmo-stp_10.42.42.5(pid=30179): stderr: | 20221213141049666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141049666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141049666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141049667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141049667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141049667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141049667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:51.228688 run osmo-stp_10.42.42.5(pid=30179): stdout: | (launched: 2022-12-13_14:10:49.495739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:51.347742 run osmo-stp_10.42.42.5(pid=30179): stderr: | 20221213141049666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141049666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141049666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141049667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141049667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141049667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141049667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:51.490741 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30179): Process ended prematurely: osmo-stp_10.42.42.5(pid=30179) [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30179)] [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 14:10:51.499248 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 14:10:51.525281 run osmo-hlr_10.42.42.2(pid=30176): ERR: Terminated: ERROR {rc=237} [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30176)] 14:10:51.573111 run osmo-hlr_10.42.42.2(pid=30176): stdout: | (launched: 2022-12-13_14:10:48.551294) 14:10:51.622277 run osmo-hlr_10.42.42.2(pid=30176): stderr: | 20221213141048726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141048726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141048726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141048726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141048727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141048727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141048739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141048747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141048747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141048747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:51.691194 run osmo-msc_10.42.42.6(pid=30182): ERR: Terminated: ERROR {rc=2} [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30182)] 14:10:51.738687 run osmo-msc_10.42.42.6(pid=30182): stdout: | (launched: 2022-12-13_14:10:50.621227) 14:10:51.787842 run osmo-msc_10.42.42.6(pid=30182): stderr: | 20221213141050893 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141050893 DLGLOBAL DEBUG validating counter group 0x7f2483c50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141050893 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141050894 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141050894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141050894 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141050896 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141050896 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141050896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141050896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:51.837420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30175): Terminating (SIGTERM) 14:10:51.879939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30178): Terminating (SIGTERM) 14:10:51.920723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30181): Terminating (SIGTERM) 14:10:51.961278 --- ParallelTerminationStrategy: PID 30175 died... 14:10:51.980480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30175): Terminated: ok {rc=0} 14:10:52.024490 --- ParallelTerminationStrategy: PID 30178 died... 14:10:52.043289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30178): Terminated: ok {rc=0} 14:10:52.087180 --- ParallelTerminationStrategy: PID 30181 died... 14:10:52.105971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30181): Terminated: ok {rc=0} 14:10:52.191618 bus /sierra_9: Setting Powered False 14:10:53.291765 bus /sierra_9: Setting Powered False 14:10:54.408155 bus /sierra_8: Setting Powered False 14:10:55.506339 bus /sierra_8: Setting Powered False 14:10:56.622315 bus /sierra_3: Setting Powered False 14:10:57.721631 bus /sierra_3: Setting Powered False 14:10:58.838070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900 --------------------------------------------------------------------- 14:11:00.121277 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:00.127011 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:11:00.160626 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 14:11:00.201759 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 14:11:00.289289 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:11:00.322545 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 14:11:00.362943 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 14:11:00.979240 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 14:11:01.038927 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.051302 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:11:01.101032 tst cs_paging_gprs_active.py: using LAC 34484 14:11:01.224265 tst cs_paging_gprs_active.py: using RAC 59 14:11:01.347421 tst cs_paging_gprs_active.py: using CellId 34484 14:11:01.470210 tst cs_paging_gprs_active.py: using BVCI 34485 14:11:01.585075 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.596346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.607572 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.618898 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.630572 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.641754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.653955 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.665391 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:01.676719 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:01.815430 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:01.947974 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:11:02.163097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:02.477969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30188): Launched 14:11:02.748283 run iperf3-srv_10.42.42.10(pid=30189): Launched 14:11:02.865714 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:11:03.071246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:03.383571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Launched 14:11:03.654267 run iperf3-srv_10.42.42.10(pid=30191): Launched 14:11:03.769739 tst cs_paging_gprs_active.py:38: start network... 14:11:03.975831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:04.455260 run create_hlr_db(pid=30192): Launched 14:11:04.582286 bus /sierra_2: Setting Powered False 14:11:05.643079 run create_hlr_db(pid=30192): Terminated: ok {rc=0} 14:11:06.092645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Launched 14:11:06.426662 run osmo-hlr_10.42.42.2(pid=30195): Launched 14:11:06.552801 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:07.126681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Launched 14:11:07.460592 run osmo-stp_10.42.42.5(pid=30198): Launched 14:11:07.587123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:11:08.158172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30200): Launched 14:11:08.286967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:11:08.567479 run patchelf(pid=30201): Launched 14:11:08.752435 run osmo-stp_10.42.42.5(pid=30198): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] 14:11:08.892291 run osmo-stp_10.42.42.5(pid=30198): stdout: | (launched: 2022-12-13_14:11:07.399325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:09.033328 run osmo-stp_10.42.42.5(pid=30198): stderr: | 20221213141107591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141107591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141107592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141107592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141107593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141107593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141107593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:09.175477 run osmo-stp_10.42.42.5(pid=30198): stdout: | (launched: 2022-12-13_14:11:07.399325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:09.310917 run osmo-stp_10.42.42.5(pid=30198): stderr: | 20221213141107591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141107591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141107592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141107592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141107593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141107593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141107593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:09.471637 run patchelf(pid=30201): Terminating (SIGINT) 14:11:09.657161 run patchelf(pid=30201): Terminated: ok {rc=0} 14:11:09.791162 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30198): Process ended prematurely: osmo-stp_10.42.42.5(pid=30198) [trial-2390↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] [trial-2390↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 14:11:09.801641 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 14:11:09.830520 run osmo-hlr_10.42.42.2(pid=30195): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30195)] 14:11:09.882023 run osmo-hlr_10.42.42.2(pid=30195): stdout: | (launched: 2022-12-13_14:11:06.364825) 14:11:09.934466 run osmo-hlr_10.42.42.2(pid=30195): stderr: | 20221213141106564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141106564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141106564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141106564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141106564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141106565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141106576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141106587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141106587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141106587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:09.987305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30188): Terminating (SIGTERM) 14:11:10.029604 run iperf3-srv_10.42.42.10(pid=30189): Terminating (SIGTERM) 14:11:10.071775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Terminating (SIGTERM) 14:11:10.114252 run iperf3-srv_10.42.42.10(pid=30191): Terminating (SIGTERM) 14:11:10.156357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Terminating (SIGTERM) 14:11:10.198991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Terminating (SIGTERM) 14:11:10.241674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30200): Terminating (SIGTERM) 14:11:10.284599 --- ParallelTerminationStrategy: PID 30188 died... 14:11:10.305326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30188): Terminated: ok {rc=0} 14:11:10.352233 --- ParallelTerminationStrategy: PID 30189 died... 14:11:10.372071 run iperf3-srv_10.42.42.10(pid=30189): Terminated {rc=256} 14:11:10.418631 --- ParallelTerminationStrategy: PID 30190 died... 14:11:10.438619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Terminated: ok {rc=0} 14:11:10.484921 --- ParallelTerminationStrategy: PID 30191 died... 14:11:10.505116 run iperf3-srv_10.42.42.10(pid=30191): Terminated {rc=256} 14:11:10.551629 --- ParallelTerminationStrategy: PID 30194 died... 14:11:10.571592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Terminated: ok {rc=0} 14:11:10.618273 --- ParallelTerminationStrategy: PID 30197 died... 14:11:10.638290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Terminated: ok {rc=0} 14:11:10.684459 --- ParallelTerminationStrategy: PID 30200 died... 14:11:10.704490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30200): Terminated: ok {rc=0} 14:11:10.792824 bus /gobi_0: Setting Powered False 14:11:11.890441 bus /gobi_0: Setting Powered False 14:11:13.005929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 14:11:14.157889 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.170192 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:11:14.221693 tst iperf3.py: using LAC 34485 14:11:14.352539 tst iperf3.py: using RAC 60 14:11:14.482170 tst iperf3.py: using CellId 34485 14:11:14.612791 tst iperf3.py: using BVCI 34486 14:11:14.732850 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.744195 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.755346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.766444 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.777779 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.789085 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.800659 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.812192 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:14.823725 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:14.945229 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:11:15.167713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:15.499666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30202): Launched 14:11:15.790373 run iperf3-srv_10.42.42.10(pid=30203): Launched 14:11:15.942456 tst iperf3.py:8: start network... 14:11:16.170152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:16.692725 run create_hlr_db(pid=30204): Launched 14:11:16.854408 bus /gobi_6: Setting Powered False 14:11:17.916054 run create_hlr_db(pid=30204): Terminated: ok {rc=0} 14:11:18.382428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30206): Launched 14:11:18.714103 run osmo-hlr_10.42.42.2(pid=30207): Launched 14:11:18.840742 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:19.415472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30209): Launched 14:11:19.747411 run osmo-stp_10.42.42.5(pid=30210): Launched 14:11:19.872600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:11:20.442731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30212): Launched 14:11:20.563925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:11:20.826588 run patchelf(pid=30213): Launched 14:11:20.998480 run osmo-stp_10.42.42.5(pid=30210): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30210)] 14:11:21.128340 run osmo-stp_10.42.42.5(pid=30210): stdout: | (launched: 2022-12-13_14:11:19.685476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:21.260187 run osmo-stp_10.42.42.5(pid=30210): stderr: | 20221213141119878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141119878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141119879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141119879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141119880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141119880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141119880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:21.392674 run osmo-stp_10.42.42.5(pid=30210): stdout: | (launched: 2022-12-13_14:11:19.685476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:21.518859 run osmo-stp_10.42.42.5(pid=30210): stderr: | 20221213141119878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141119878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141119879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141119879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141119880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141119880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141119880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:21.667609 run patchelf(pid=30213): Terminating (SIGINT) 14:11:21.841650 run patchelf(pid=30213): Terminated: ok {rc=0} 14:11:21.966140 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30210): Process ended prematurely: osmo-stp_10.42.42.5(pid=30210) [trial-2390↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30210)] [trial-2390↪gprs:nanobts+band-900↪iperf3.py:8] 14:11:21.975789 tst iperf3.py:8: Test FAILED (7.9 sec) 14:11:22.002932 run osmo-hlr_10.42.42.2(pid=30207): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30207)] 14:11:22.050298 run osmo-hlr_10.42.42.2(pid=30207): stdout: | (launched: 2022-12-13_14:11:18.652427) 14:11:22.099583 run osmo-hlr_10.42.42.2(pid=30207): stderr: | 20221213141118851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141118852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141118852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141118852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141118852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141118852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141118864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141118873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141118873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141118873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:22.149100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30202): Terminating (SIGTERM) 14:11:22.189380 run iperf3-srv_10.42.42.10(pid=30203): Terminating (SIGTERM) 14:11:22.229092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30206): Terminating (SIGTERM) 14:11:22.268893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30209): Terminating (SIGTERM) 14:11:22.308653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30212): Terminating (SIGTERM) 14:11:22.348632 --- ParallelTerminationStrategy: PID 30202 died... 14:11:22.368058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30202): Terminated: ok {rc=0} 14:11:22.412346 --- ParallelTerminationStrategy: PID 30203 died... 14:11:22.431364 run iperf3-srv_10.42.42.10(pid=30203): Terminated {rc=256} 14:11:22.475575 --- ParallelTerminationStrategy: PID 30206 died... 14:11:22.494477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30206): Terminated: ok {rc=0} 14:11:22.538433 --- ParallelTerminationStrategy: PID 30209 died... 14:11:22.557240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30209): Terminated: ok {rc=0} 14:11:22.601336 --- ParallelTerminationStrategy: PID 30212 died... 14:11:22.619814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30212): Terminated: ok {rc=0} 14:11:22.703479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 14:11:23.854352 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:23.869388 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:11:23.916068 tst iperf3m4.py: using LAC 34486 14:11:24.048100 tst iperf3m4.py: using RAC 61 14:11:24.170667 tst iperf3m4.py: using CellId 34486 14:11:24.302503 tst iperf3m4.py: using BVCI 34487 14:11:24.425370 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.436929 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.448423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.460013 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.471541 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.483185 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.495064 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.506649 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:24.518489 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:24.641864 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:24.765599 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:24.886125 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:25.007345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:11:25.231286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:25.563796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Launched 14:11:25.854501 run iperf3-srv_10.42.42.10(pid=30215): Launched 14:11:25.978839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:11:26.201250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:26.532802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Launched 14:11:26.821964 run iperf3-srv_10.42.42.10(pid=30217): Launched 14:11:26.948323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:11:27.171416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:27.504140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Launched 14:11:27.793780 run iperf3-srv_10.42.42.10(pid=30219): Launched 14:11:27.918241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:11:28.141586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:11:28.474625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Launched 14:11:28.762454 run iperf3-srv_10.42.42.10(pid=30221): Launched 14:11:28.888362 tst iperf3m4.py:8: start network... 14:11:29.110678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:29.623892 run create_hlr_db(pid=30222): Launched 14:11:29.750322 bus /gobi_6: Setting Powered False 14:11:30.815240 run create_hlr_db(pid=30222): Terminated: ok {rc=0} 14:11:31.290734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Launched 14:11:31.637777 run osmo-hlr_10.42.42.2(pid=30225): Launched 14:11:31.881709 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:32.582496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Launched 14:11:32.895247 run osmo-stp_10.42.42.5(pid=30228): Launched 14:11:33.014870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:11:33.548681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30230): Launched 14:11:33.667380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:11:33.929071 run patchelf(pid=30231): Launched 14:11:34.100830 run osmo-stp_10.42.42.5(pid=30228): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] 14:11:34.231036 run osmo-stp_10.42.42.5(pid=30228): stdout: | (launched: 2022-12-13_14:11:32.836668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:34.363086 run osmo-stp_10.42.42.5(pid=30228): stderr: | 20221213141133008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141133008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141133008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141133008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141133009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141133009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141133009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:34.495138 run osmo-stp_10.42.42.5(pid=30228): stdout: | (launched: 2022-12-13_14:11:32.836668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:34.621255 run osmo-stp_10.42.42.5(pid=30228): stderr: | 20221213141133008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141133008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141133008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141133008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141133009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141133009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141133009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:34.770661 run patchelf(pid=30231): Terminating (SIGINT) 14:11:34.944875 run patchelf(pid=30231): Terminated: ok {rc=0} 14:11:35.069538 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30228): Process ended prematurely: osmo-stp_10.42.42.5(pid=30228) [trial-2390↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] [trial-2390↪gprs:nanobts+band-900↪iperf3m4.py:8] 14:11:35.079111 tst iperf3m4.py:8: Test FAILED (11.3 sec) 14:11:35.106697 run osmo-hlr_10.42.42.2(pid=30225): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30225)] 14:11:35.154161 run osmo-hlr_10.42.42.2(pid=30225): stdout: | (launched: 2022-12-13_14:11:31.575974) 14:11:35.203503 run osmo-hlr_10.42.42.2(pid=30225): stderr: | 20221213141131824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141131824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141131824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141131824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141131824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141131824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141131840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141131863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141131863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141131863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:35.253471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Terminating (SIGTERM) 14:11:35.293488 run iperf3-srv_10.42.42.10(pid=30215): Terminating (SIGTERM) 14:11:35.333596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminating (SIGTERM) 14:11:35.374239 run iperf3-srv_10.42.42.10(pid=30217): Terminating (SIGTERM) 14:11:35.414740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Terminating (SIGTERM) 14:11:35.455344 run iperf3-srv_10.42.42.10(pid=30219): Terminating (SIGTERM) 14:11:35.495674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminating (SIGTERM) 14:11:35.535718 run iperf3-srv_10.42.42.10(pid=30221): Terminating (SIGTERM) 14:11:35.576199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Terminating (SIGTERM) 14:11:35.616383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Terminating (SIGTERM) 14:11:35.656598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30230): Terminating (SIGTERM) 14:11:35.697314 --- ParallelTerminationStrategy: PID 30214 died... 14:11:35.716737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Terminated: ok {rc=0} 14:11:35.761228 --- ParallelTerminationStrategy: PID 30215 died... 14:11:35.780121 run iperf3-srv_10.42.42.10(pid=30215): Terminated {rc=256} 14:11:35.824013 --- ParallelTerminationStrategy: PID 30216 died... 14:11:35.842823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminated: ok {rc=0} 14:11:35.886709 --- ParallelTerminationStrategy: PID 30217 died... 14:11:35.905594 run iperf3-srv_10.42.42.10(pid=30217): Terminated {rc=256} 14:11:35.949425 --- ParallelTerminationStrategy: PID 30218 died... 14:11:35.968004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Terminated: ok {rc=0} 14:11:36.012357 --- ParallelTerminationStrategy: PID 30219 died... 14:11:36.031318 run iperf3-srv_10.42.42.10(pid=30219): Terminated {rc=256} 14:11:36.075041 --- ParallelTerminationStrategy: PID 30220 died... 14:11:36.093664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminated: ok {rc=0} 14:11:36.137307 --- ParallelTerminationStrategy: PID 30221 died... 14:11:36.155815 run iperf3-srv_10.42.42.10(pid=30221): Terminated {rc=256} 14:11:36.199458 --- ParallelTerminationStrategy: PID 30224 died... 14:11:36.218201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30224): Terminated: ok {rc=0} 14:11:36.262077 --- ParallelTerminationStrategy: PID 30227 died... 14:11:36.280921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30227): Terminated: ok {rc=0} 14:11:36.325066 --- ParallelTerminationStrategy: PID 30230 died... 14:11:36.343995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30230): Terminated: ok {rc=0} 14:11:36.427754 bus /gobi_4: Setting Powered False 14:11:37.525276 bus /gobi_4: Setting Powered False 14:11:38.642345 bus /gobi_1: Setting Powered False 14:11:39.740354 bus /gobi_1: Setting Powered False 14:11:40.857149 bus /gobi_0: Setting Powered False 14:11:41.957980 bus /gobi_0: Setting Powered False 14:11:43.074974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900 ping.py ---------------------------------------------- 14:11:44.177737 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.189731 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:11:44.238794 tst ping.py: using LAC 34487 14:11:44.358584 tst ping.py: using RAC 62 14:11:44.480334 tst ping.py: using CellId 34487 14:11:44.600182 tst ping.py: using BVCI 34488 14:11:44.719625 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.730898 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.742096 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.753461 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.764534 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.775812 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.787256 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:44.798661 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:44.915514 tst ping.py:19: start network... 14:11:45.117450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:45.585276 run create_hlr_db(pid=30232): Launched 14:11:45.709865 bus /gobi_6: Setting Powered False 14:11:46.804892 run create_hlr_db(pid=30232): Terminated: ok {rc=0} 14:11:47.283301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30234): Launched 14:11:47.609526 run osmo-hlr_10.42.42.2(pid=30235): Launched 14:11:47.732703 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:48.296825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30237): Launched 14:11:48.622772 run osmo-stp_10.42.42.5(pid=30238): Launched 14:11:48.746616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:11:49.304024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30240): Launched 14:11:49.429062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:11:49.703017 run patchelf(pid=30241): Launched 14:11:49.882910 run osmo-stp_10.42.42.5(pid=30238): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30238)] 14:11:50.020189 run osmo-stp_10.42.42.5(pid=30238): stdout: | (launched: 2022-12-13_14:11:48.562436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:50.159842 run osmo-stp_10.42.42.5(pid=30238): stderr: | 20221213141148756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141148756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141148757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141148757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141148758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141148758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141148758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:50.300135 run osmo-stp_10.42.42.5(pid=30238): stdout: | (launched: 2022-12-13_14:11:48.562436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:50.432825 run osmo-stp_10.42.42.5(pid=30238): stderr: | 20221213141148756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141148756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141148757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141148757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141148758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141148758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141148758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:50.590362 run patchelf(pid=30241): Terminating (SIGINT) 14:11:50.771750 run patchelf(pid=30241): Terminated: ok {rc=0} 14:11:50.902713 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30238): Process ended prematurely: osmo-stp_10.42.42.5(pid=30238) [trial-2390↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30238)] [trial-2390↪gprs:nanobts+band-900↪ping.py:22] 14:11:50.912540 tst ping.py:22: Test FAILED (6.7 sec) 14:11:50.941048 run osmo-hlr_10.42.42.2(pid=30235): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30235)] 14:11:50.992260 run osmo-hlr_10.42.42.2(pid=30235): stdout: | (launched: 2022-12-13_14:11:47.549223) 14:11:51.044308 run osmo-hlr_10.42.42.2(pid=30235): stderr: | 20221213141147747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141147747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141147747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141147747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141147748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141147748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141147763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141147772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141147772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141147772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:51.096914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30234): Terminating (SIGTERM) 14:11:51.138929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30237): Terminating (SIGTERM) 14:11:51.181550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30240): Terminating (SIGTERM) 14:11:51.224248 --- ParallelTerminationStrategy: PID 30234 died... 14:11:51.245299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30234): Terminated: ok {rc=0} 14:11:51.291995 --- ParallelTerminationStrategy: PID 30237 died... 14:11:51.312295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30237): Terminated: ok {rc=0} 14:11:51.358819 --- ParallelTerminationStrategy: PID 30240 died... 14:11:51.379080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30240): Terminated: ok {rc=0} 14:11:51.467512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 14:11:52.553337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:52.565222 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:11:52.618231 tst ping_idle_ping.py: using LAC 34488 14:11:52.745265 tst ping_idle_ping.py: using RAC 63 14:11:52.872141 tst ping_idle_ping.py: using CellId 34488 14:11:52.997317 tst ping_idle_ping.py: using BVCI 34489 14:11:53.114883 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.126137 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.137311 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.148251 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.160366 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.172078 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.184266 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:11:53.195991 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:11:53.313733 tst ping_idle_ping.py:24: start network... 14:11:53.515849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:53.987441 run create_hlr_db(pid=30242): Launched 14:11:54.118966 bus /gobi_6: Setting Powered False 14:11:55.183997 run create_hlr_db(pid=30242): Terminated: ok {rc=0} 14:11:55.619080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30244): Launched 14:11:55.924693 run osmo-hlr_10.42.42.2(pid=30245): Launched 14:11:56.040458 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:56.578340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30247): Launched 14:11:56.884688 run osmo-stp_10.42.42.5(pid=30248): Launched 14:11:57.001451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:11:57.524746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30250): Launched 14:11:57.644581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:11:57.901654 run patchelf(pid=30251): Launched 14:11:58.072856 run osmo-stp_10.42.42.5(pid=30248): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30248)] 14:11:58.201794 run osmo-stp_10.42.42.5(pid=30248): stdout: | (launched: 2022-12-13_14:11:56.827677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:58.332198 run osmo-stp_10.42.42.5(pid=30248): stderr: | 20221213141157000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141157000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141157000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141157001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141157001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141157001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141157001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:58.463408 run osmo-stp_10.42.42.5(pid=30248): stdout: | (launched: 2022-12-13_14:11:56.827677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:58.587763 run osmo-stp_10.42.42.5(pid=30248): stderr: | 20221213141157000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141157000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141157000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141157001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141157001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141157001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141157001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:58.735367 run patchelf(pid=30251): Terminating (SIGINT) 14:11:58.907193 run patchelf(pid=30251): Terminated: ok {rc=0} 14:11:59.030667 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30248): Process ended prematurely: osmo-stp_10.42.42.5(pid=30248) [trial-2390↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30248)] [trial-2390↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 14:11:59.039504 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 14:11:59.066479 run osmo-hlr_10.42.42.2(pid=30245): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30245)] 14:11:59.113869 run osmo-hlr_10.42.42.2(pid=30245): stdout: | (launched: 2022-12-13_14:11:55.867748) 14:11:59.162755 run osmo-hlr_10.42.42.2(pid=30245): stderr: | 20221213141156044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141156044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141156045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141156045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141156045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141156045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141156058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141156067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141156067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141156067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:59.212658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30244): Terminating (SIGTERM) 14:11:59.252592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30247): Terminating (SIGTERM) 14:11:59.292505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30250): Terminating (SIGTERM) 14:11:59.332886 --- ParallelTerminationStrategy: PID 30244 died... 14:11:59.352525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30244): Terminated: ok {rc=0} 14:11:59.396851 --- ParallelTerminationStrategy: PID 30247 died... 14:11:59.415803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30247): Terminated: ok {rc=0} 14:11:59.459994 --- ParallelTerminationStrategy: PID 30250 died... 14:11:59.478698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30250): Terminated: ok {rc=0} 14:11:59.564446 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 14:12:00.878875 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:00.886184 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:12:00.928234 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:12:00.979134 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:12:01.071505 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:12:01.105958 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:12:01.153929 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:12:01.789570 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:12:01.842313 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:01.854960 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:12:01.902851 tst cs_paging_gprs_active.py: using LAC 34489 14:12:02.056585 tst cs_paging_gprs_active.py: using RAC 64 14:12:02.191577 tst cs_paging_gprs_active.py: using CellId 34489 14:12:02.322221 tst cs_paging_gprs_active.py: using BVCI 34490 14:12:02.443478 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.455093 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.466414 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.477757 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.489739 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.502064 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.514224 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.526299 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:02.538495 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:02.663639 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:02.782720 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:12:02.990955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:03.303583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30255): Launched 14:12:03.575990 run iperf3-srv_10.42.42.10(pid=30256): Launched 14:12:03.695581 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:12:03.902293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:04.213905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Launched 14:12:04.487856 run iperf3-srv_10.42.42.10(pid=30258): Launched 14:12:04.605199 tst cs_paging_gprs_active.py:38: start network... 14:12:04.810996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:05.289094 run create_hlr_db(pid=30259): Launched 14:12:05.416549 bus /gobi_6: Setting Powered False 14:12:06.478370 run create_hlr_db(pid=30259): Terminated: ok {rc=0} 14:12:06.930631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30261): Launched 14:12:07.265215 run osmo-hlr_10.42.42.2(pid=30262): Launched 14:12:07.393159 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:07.965633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30264): Launched 14:12:08.298600 run osmo-stp_10.42.42.5(pid=30265): Launched 14:12:08.426561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:12:08.995721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30267): Launched 14:12:09.123297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:12:09.404138 run patchelf(pid=30268): Launched 14:12:09.590308 run osmo-stp_10.42.42.5(pid=30265): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30265)] 14:12:09.730039 run osmo-stp_10.42.42.5(pid=30265): stdout: | (launched: 2022-12-13_14:12:08.236898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:09.871465 run osmo-stp_10.42.42.5(pid=30265): stderr: | 20221213141208429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141208430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141208430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141208430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141208431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141208431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141208431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:10.012556 run osmo-stp_10.42.42.5(pid=30265): stdout: | (launched: 2022-12-13_14:12:08.236898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:10.147702 run osmo-stp_10.42.42.5(pid=30265): stderr: | 20221213141208429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141208430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141208430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141208430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141208431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141208431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141208431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:10.308400 run patchelf(pid=30268): Terminating (SIGINT) 14:12:10.493220 run patchelf(pid=30268): Terminated: ok {rc=0} 14:12:10.626529 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30265): Process ended prematurely: osmo-stp_10.42.42.5(pid=30265) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30265)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:12:10.636716 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 14:12:10.665463 run osmo-hlr_10.42.42.2(pid=30262): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30262)] 14:12:10.716909 run osmo-hlr_10.42.42.2(pid=30262): stdout: | (launched: 2022-12-13_14:12:07.203539) 14:12:10.769465 run osmo-hlr_10.42.42.2(pid=30262): stderr: | 20221213141207401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141207401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141207401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141207401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141207401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141207401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141207414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141207423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141207423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141207423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:10.822214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30255): Terminating (SIGTERM) 14:12:10.864554 run iperf3-srv_10.42.42.10(pid=30256): Terminating (SIGTERM) 14:12:10.907085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Terminating (SIGTERM) 14:12:10.949775 run iperf3-srv_10.42.42.10(pid=30258): Terminating (SIGTERM) 14:12:10.992353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30261): Terminating (SIGTERM) 14:12:11.035430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30264): Terminating (SIGTERM) 14:12:11.078318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30267): Terminating (SIGTERM) 14:12:11.121128 --- ParallelTerminationStrategy: PID 30255 died... 14:12:11.142034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30255): Terminated: ok {rc=0} 14:12:11.189081 --- ParallelTerminationStrategy: PID 30256 died... 14:12:11.209508 run iperf3-srv_10.42.42.10(pid=30256): Terminated {rc=256} 14:12:11.256333 --- ParallelTerminationStrategy: PID 30257 died... 14:12:11.276657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Terminated: ok {rc=0} 14:12:11.323561 --- ParallelTerminationStrategy: PID 30258 died... 14:12:11.343766 run iperf3-srv_10.42.42.10(pid=30258): Terminated {rc=256} 14:12:11.390582 --- ParallelTerminationStrategy: PID 30261 died... 14:12:11.410804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30261): Terminated: ok {rc=0} 14:12:11.457705 --- ParallelTerminationStrategy: PID 30264 died... 14:12:11.477870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30264): Terminated: ok {rc=0} 14:12:11.524732 --- ParallelTerminationStrategy: PID 30267 died... 14:12:11.545012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30267): Terminated: ok {rc=0} 14:12:11.635029 bus /gobi_0: Setting Powered False 14:12:12.734885 bus /gobi_0: Setting Powered False 14:12:13.851737 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:12:15.002622 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.014658 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:12:15.069435 tst iperf3.py: using LAC 34490 14:12:15.199225 tst iperf3.py: using RAC 65 14:12:15.328113 tst iperf3.py: using CellId 34490 14:12:15.458964 tst iperf3.py: using BVCI 34491 14:12:15.580650 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.592204 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.603523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.615027 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.626563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.638213 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.650016 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.661507 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:15.673283 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:15.791461 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:12:16.029973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:16.369286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30269): Launched 14:12:16.672377 run iperf3-srv_10.42.42.10(pid=30270): Launched 14:12:16.812827 tst iperf3.py:8: start network... 14:12:17.040230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:17.556910 run create_hlr_db(pid=30271): Launched 14:12:17.685274 bus /gobi_6: Setting Powered False 14:12:18.750086 run create_hlr_db(pid=30271): Terminated: ok {rc=0} 14:12:19.190327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30273): Launched 14:12:19.500228 run osmo-hlr_10.42.42.2(pid=30274): Launched 14:12:19.618214 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:20.155384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30276): Launched 14:12:20.466689 run osmo-stp_10.42.42.5(pid=30277): Launched 14:12:20.586416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:12:21.116295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30279): Launched 14:12:21.236121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:12:21.498168 run patchelf(pid=30280): Launched 14:12:21.668771 run osmo-stp_10.42.42.5(pid=30277): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30277)] 14:12:21.798844 run osmo-stp_10.42.42.5(pid=30277): stdout: | (launched: 2022-12-13_14:12:20.408565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:21.931672 run osmo-stp_10.42.42.5(pid=30277): stderr: | 20221213141220581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141220581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141220581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141220582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141220582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141220582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141220582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:22.064225 run osmo-stp_10.42.42.5(pid=30277): stdout: | (launched: 2022-12-13_14:12:20.408565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:22.190336 run osmo-stp_10.42.42.5(pid=30277): stderr: | 20221213141220581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141220581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141220581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141220582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141220582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141220582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141220582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:22.339776 run patchelf(pid=30280): Terminating (SIGINT) 14:12:22.512552 run patchelf(pid=30280): Terminated: ok {rc=0} 14:12:22.637118 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30277): Process ended prematurely: osmo-stp_10.42.42.5(pid=30277) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30277)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 14:12:22.646927 tst iperf3.py:8: Test FAILED (7.7 sec) 14:12:22.674359 run osmo-hlr_10.42.42.2(pid=30274): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30274)] 14:12:22.722657 run osmo-hlr_10.42.42.2(pid=30274): stdout: | (launched: 2022-12-13_14:12:19.441766) 14:12:22.772324 run osmo-hlr_10.42.42.2(pid=30274): stderr: | 20221213141219617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141219617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141219617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141219617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141219617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141219617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141219630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141219638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141219638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141219638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:22.822511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30269): Terminating (SIGTERM) 14:12:22.862532 run iperf3-srv_10.42.42.10(pid=30270): Terminating (SIGTERM) 14:12:22.902350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30273): Terminating (SIGTERM) 14:12:22.942548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30276): Terminating (SIGTERM) 14:12:22.982440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30279): Terminating (SIGTERM) 14:12:23.022696 --- ParallelTerminationStrategy: PID 30269 died... 14:12:23.042063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30269): Terminated: ok {rc=0} 14:12:23.086414 --- ParallelTerminationStrategy: PID 30270 died... 14:12:23.105374 run iperf3-srv_10.42.42.10(pid=30270): Terminated {rc=256} 14:12:23.149276 --- ParallelTerminationStrategy: PID 30273 died... 14:12:23.168235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30273): Terminated: ok {rc=0} 14:12:23.212823 --- ParallelTerminationStrategy: PID 30276 died... 14:12:23.232185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30276): Terminated: ok {rc=0} 14:12:23.276019 --- ParallelTerminationStrategy: PID 30279 died... 14:12:23.295093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30279): Terminated: ok {rc=0} 14:12:23.381441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:12:24.535950 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:24.548026 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:12:24.600325 tst iperf3m4.py: using LAC 34491 14:12:24.731424 tst iperf3m4.py: using RAC 66 14:12:24.862397 tst iperf3m4.py: using CellId 34491 14:12:24.991216 tst iperf3m4.py: using BVCI 34492 14:12:25.113318 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.124773 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.136243 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.147622 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.159170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.170709 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.182503 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.194121 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:25.206277 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:25.328819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:25.450080 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:25.572119 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:25.691181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:12:25.900657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:26.212026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Launched 14:12:26.484444 run iperf3-srv_10.42.42.10(pid=30282): Launched 14:12:26.602990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:12:26.809749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:27.121691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30283): Launched 14:12:27.395431 run iperf3-srv_10.42.42.10(pid=30284): Launched 14:12:27.513158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:12:27.719415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:28.031325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30285): Launched 14:12:28.303589 run iperf3-srv_10.42.42.10(pid=30286): Launched 14:12:28.421862 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:12:28.628300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:12:28.939504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30287): Launched 14:12:29.211082 run iperf3-srv_10.42.42.10(pid=30288): Launched 14:12:29.328484 tst iperf3m4.py:8: start network... 14:12:29.534832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:30.016333 run create_hlr_db(pid=30289): Launched 14:12:30.145963 bus /gobi_6: Setting Powered False 14:12:31.223244 run create_hlr_db(pid=30289): Terminated: ok {rc=0} 14:12:31.714187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Launched 14:12:32.059103 run osmo-hlr_10.42.42.2(pid=30292): Launched 14:12:32.233433 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:32.806755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Launched 14:12:33.139468 run osmo-stp_10.42.42.5(pid=30295): Launched 14:12:33.267836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:12:33.838821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30297): Launched 14:12:33.961347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:12:34.223088 run patchelf(pid=30298): Launched 14:12:34.394969 run osmo-stp_10.42.42.5(pid=30295): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] 14:12:34.524487 run osmo-stp_10.42.42.5(pid=30295): stdout: | (launched: 2022-12-13_14:12:33.077812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:34.655667 run osmo-stp_10.42.42.5(pid=30295): stderr: | 20221213141233270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141233270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141233271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141233271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141233271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141233272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141233272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:34.787485 run osmo-stp_10.42.42.5(pid=30295): stdout: | (launched: 2022-12-13_14:12:33.077812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:34.913231 run osmo-stp_10.42.42.5(pid=30295): stderr: | 20221213141233270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141233270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141233271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141233271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141233271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141233272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141233272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:35.062889 run patchelf(pid=30298): Terminating (SIGINT) 14:12:35.236149 run patchelf(pid=30298): Terminated: ok {rc=0} 14:12:35.360325 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30295): Process ended prematurely: osmo-stp_10.42.42.5(pid=30295) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 14:12:35.370065 tst iperf3m4.py:8: Test FAILED (10.9 sec) 14:12:35.397673 run osmo-hlr_10.42.42.2(pid=30292): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30292)] 14:12:35.444858 run osmo-hlr_10.42.42.2(pid=30292): stdout: | (launched: 2022-12-13_14:12:31.997238) 14:12:35.494025 run osmo-hlr_10.42.42.2(pid=30292): stderr: | 20221213141232234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141232234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141232234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141232234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141232234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141232235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141232246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141232255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141232256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141232256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:35.543452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Terminating (SIGTERM) 14:12:35.582892 run iperf3-srv_10.42.42.10(pid=30282): Terminating (SIGTERM) 14:12:35.622321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30283): Terminating (SIGTERM) 14:12:35.661836 run iperf3-srv_10.42.42.10(pid=30284): Terminating (SIGTERM) 14:12:35.701070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30285): Terminating (SIGTERM) 14:12:35.740910 run iperf3-srv_10.42.42.10(pid=30286): Terminating (SIGTERM) 14:12:35.780336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30287): Terminating (SIGTERM) 14:12:35.819908 run iperf3-srv_10.42.42.10(pid=30288): Terminating (SIGTERM) 14:12:35.859253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Terminating (SIGTERM) 14:12:35.898721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Terminating (SIGTERM) 14:12:35.938697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30297): Terminating (SIGTERM) 14:12:35.978881 --- ParallelTerminationStrategy: PID 30281 died... 14:12:35.998035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Terminated: ok {rc=0} 14:12:36.041597 --- ParallelTerminationStrategy: PID 30282 died... 14:12:36.059986 run iperf3-srv_10.42.42.10(pid=30282): Terminated {rc=256} 14:12:36.103479 --- ParallelTerminationStrategy: PID 30283 died... 14:12:36.122061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30283): Terminated: ok {rc=0} 14:12:36.165558 --- ParallelTerminationStrategy: PID 30284 died... 14:12:36.184138 run iperf3-srv_10.42.42.10(pid=30284): Terminated {rc=256} 14:12:36.227681 --- ParallelTerminationStrategy: PID 30285 died... 14:12:36.246303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30285): Terminated: ok {rc=0} 14:12:36.289829 --- ParallelTerminationStrategy: PID 30286 died... 14:12:36.308392 run iperf3-srv_10.42.42.10(pid=30286): Terminated {rc=256} 14:12:36.358791 --- ParallelTerminationStrategy: PID 30287 died... 14:12:36.378496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30287): Terminated: ok {rc=0} 14:12:36.425446 --- ParallelTerminationStrategy: PID 30288 died... 14:12:36.446019 run iperf3-srv_10.42.42.10(pid=30288): Terminated {rc=256} 14:12:36.493217 --- ParallelTerminationStrategy: PID 30291 died... 14:12:36.513876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Terminated: ok {rc=0} 14:12:36.561325 --- ParallelTerminationStrategy: PID 30294 died... 14:12:36.581847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Terminated: ok {rc=0} 14:12:36.628925 --- ParallelTerminationStrategy: PID 30297 died... 14:12:36.649642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30297): Terminated: ok {rc=0} 14:12:36.740021 bus /gobi_4: Setting Powered False 14:12:37.838123 bus /gobi_4: Setting Powered False 14:12:38.955638 bus /gobi_1: Setting Powered False 14:12:40.058295 bus /gobi_1: Setting Powered False 14:12:41.175780 bus /gobi_0: Setting Powered False 14:12:42.275269 bus /gobi_0: Setting Powered False 14:12:43.393787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 14:12:44.497422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:44.509940 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:12:44.562564 tst ping.py: using LAC 34492 14:12:44.689794 tst ping.py: using RAC 67 14:12:44.818366 tst ping.py: using CellId 34492 14:12:44.946678 tst ping.py: using BVCI 34493 14:12:45.066798 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.078505 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.090017 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.101829 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.113444 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.125323 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.137310 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:45.148910 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:45.266191 tst ping.py:19: start network... 14:12:45.468372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:45.954698 run create_hlr_db(pid=30299): Launched 14:12:46.113901 bus /gobi_6: Setting Powered False 14:12:47.195242 run create_hlr_db(pid=30299): Terminated: ok {rc=0} 14:12:47.634617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30301): Launched 14:12:47.938889 run osmo-hlr_10.42.42.2(pid=30302): Launched 14:12:48.055144 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:48.598557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30304): Launched 14:12:48.901593 run osmo-stp_10.42.42.5(pid=30305): Launched 14:12:49.018274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:12:49.545258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30307): Launched 14:12:49.662833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:12:49.920159 run patchelf(pid=30308): Launched 14:12:50.092365 run osmo-stp_10.42.42.5(pid=30305): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30305)] 14:12:50.221273 run osmo-stp_10.42.42.5(pid=30305): stdout: | (launched: 2022-12-13_14:12:48.844529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:50.350852 run osmo-stp_10.42.42.5(pid=30305): stderr: | 20221213141249016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141249016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141249016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141249016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141249017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141249017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141249017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:50.481369 run osmo-stp_10.42.42.5(pid=30305): stdout: | (launched: 2022-12-13_14:12:48.844529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:50.604633 run osmo-stp_10.42.42.5(pid=30305): stderr: | 20221213141249016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141249016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141249016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141249016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141249017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141249017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141249017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:50.751558 run patchelf(pid=30308): Terminating (SIGINT) 14:12:50.921153 run patchelf(pid=30308): Terminated: ok {rc=0} 14:12:51.043474 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30305): Process ended prematurely: osmo-stp_10.42.42.5(pid=30305) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30305)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 14:12:51.052528 tst ping.py:22: Test FAILED (6.5 sec) 14:12:51.079663 run osmo-hlr_10.42.42.2(pid=30302): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30302)] 14:12:51.127650 run osmo-hlr_10.42.42.2(pid=30302): stdout: | (launched: 2022-12-13_14:12:47.882266) 14:12:51.177099 run osmo-hlr_10.42.42.2(pid=30302): stderr: | 20221213141248057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141248058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141248058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141248058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141248058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141248058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141248070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141248078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141248079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141248079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:51.227059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30301): Terminating (SIGTERM) 14:12:51.267441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30304): Terminating (SIGTERM) 14:12:51.307342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30307): Terminating (SIGTERM) 14:12:51.347409 --- ParallelTerminationStrategy: PID 30301 died... 14:12:51.366838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30301): Terminated: ok {rc=0} 14:12:51.411013 --- ParallelTerminationStrategy: PID 30304 died... 14:12:51.429951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30304): Terminated: ok {rc=0} 14:12:51.474127 --- ParallelTerminationStrategy: PID 30307 died... 14:12:51.492992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30307): Terminated: ok {rc=0} 14:12:51.579444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:12:52.669235 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:52.681527 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:12:52.733149 tst ping_idle_ping.py: using LAC 34493 14:12:52.853044 tst ping_idle_ping.py: using RAC 68 14:12:52.971582 tst ping_idle_ping.py: using CellId 34493 14:12:53.092519 tst ping_idle_ping.py: using BVCI 34494 14:12:53.203793 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.214950 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.225932 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.236743 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.248007 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.259230 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.270722 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:12:53.282123 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:12:53.405039 tst ping_idle_ping.py:24: start network... 14:12:53.623685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:54.128184 run create_hlr_db(pid=30309): Launched 14:12:54.253549 bus /gobi_6: Setting Powered False 14:12:55.318306 run create_hlr_db(pid=30309): Terminated: ok {rc=0} 14:12:55.771817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30311): Launched 14:12:56.098071 run osmo-hlr_10.42.42.2(pid=30312): Launched 14:12:56.222049 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:56.785979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30314): Launched 14:12:57.113637 run osmo-stp_10.42.42.5(pid=30315): Launched 14:12:57.239415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:12:57.802106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30317): Launched 14:12:57.925645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:12:58.200248 run patchelf(pid=30318): Launched 14:12:58.382867 run osmo-stp_10.42.42.5(pid=30315): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30315)] 14:12:58.519838 run osmo-stp_10.42.42.5(pid=30315): stdout: | (launched: 2022-12-13_14:12:57.052615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:58.659489 run osmo-stp_10.42.42.5(pid=30315): stderr: | 20221213141257244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141257244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141257244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141257245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141257245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141257245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141257245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:58.799165 run osmo-stp_10.42.42.5(pid=30315): stdout: | (launched: 2022-12-13_14:12:57.052615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:58.931690 run osmo-stp_10.42.42.5(pid=30315): stderr: | 20221213141257244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141257244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141257244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141257245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141257245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141257245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141257245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:59.088630 run patchelf(pid=30318): Terminating (SIGINT) 14:12:59.271666 run patchelf(pid=30318): Terminated: ok {rc=0} 14:12:59.403327 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30315): Process ended prematurely: osmo-stp_10.42.42.5(pid=30315) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30315)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 14:12:59.412931 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:12:59.441133 run osmo-hlr_10.42.42.2(pid=30312): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30312)] 14:12:59.491559 run osmo-hlr_10.42.42.2(pid=30312): stdout: | (launched: 2022-12-13_14:12:56.037487) 14:12:59.543924 run osmo-hlr_10.42.42.2(pid=30312): stderr: | 20221213141256235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141256235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141256235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141256235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141256235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141256235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141256247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141256257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141256257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141256257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:59.596202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30311): Terminating (SIGTERM) 14:12:59.638340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30314): Terminating (SIGTERM) 14:12:59.680710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30317): Terminating (SIGTERM) 14:12:59.723351 --- ParallelTerminationStrategy: PID 30311 died... 14:12:59.743987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30311): Terminated: ok {rc=0} 14:12:59.791012 --- ParallelTerminationStrategy: PID 30314 died... 14:12:59.811148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30314): Terminated: ok {rc=0} 14:12:59.857816 --- ParallelTerminationStrategy: PID 30317 died... 14:12:59.877918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30317): Terminated: ok {rc=0} 14:12:59.966828 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:13:01.286399 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:01.293547 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:13:01.326965 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:13:01.368257 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:13:01.458097 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:13:01.503194 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:13:01.556526 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:13:02.129350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:13:02.189111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.200484 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:13:02.269326 tst cs_paging_gprs_active.py: using LAC 34494 14:13:02.391176 tst cs_paging_gprs_active.py: using RAC 69 14:13:02.513715 tst cs_paging_gprs_active.py: using CellId 34494 14:13:02.635409 tst cs_paging_gprs_active.py: using BVCI 34495 14:13:02.749271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.760322 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.771348 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.782156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.793455 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.804673 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.816051 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.827296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:02.838724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:02.962476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:03.084401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:13:03.307842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:03.639610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30322): Launched 14:13:03.928817 run iperf3-srv_10.42.42.10(pid=30323): Launched 14:13:04.054565 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:13:04.277885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:04.611001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30324): Launched 14:13:04.899623 run iperf3-srv_10.42.42.10(pid=30325): Launched 14:13:05.025070 tst cs_paging_gprs_active.py:38: start network... 14:13:05.247581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:05.760030 run create_hlr_db(pid=30326): Launched 14:13:05.888716 bus /gobi_6: Setting Powered False 14:13:06.953470 run create_hlr_db(pid=30326): Terminated: ok {rc=0} 14:13:07.394696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30328): Launched 14:13:07.705928 run osmo-hlr_10.42.42.2(pid=30329): Launched 14:13:07.824349 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:08.371749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30331): Launched 14:13:08.683893 run osmo-stp_10.42.42.5(pid=30332): Launched 14:13:08.802836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:13:09.337517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30334): Launched 14:13:09.456283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:13:09.719723 run patchelf(pid=30335): Launched 14:13:09.892677 run osmo-stp_10.42.42.5(pid=30332): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30332)] 14:13:10.022841 run osmo-stp_10.42.42.5(pid=30332): stdout: | (launched: 2022-12-13_14:13:08.625433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:10.154837 run osmo-stp_10.42.42.5(pid=30332): stderr: | 20221213141308796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141308796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141308796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141308797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141308797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141308797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141308797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:10.287629 run osmo-stp_10.42.42.5(pid=30332): stdout: | (launched: 2022-12-13_14:13:08.625433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:10.414326 run osmo-stp_10.42.42.5(pid=30332): stderr: | 20221213141308796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141308796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141308796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141308797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141308797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141308797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141308797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:10.563754 run patchelf(pid=30335): Terminating (SIGINT) 14:13:10.736606 run patchelf(pid=30335): Terminated: ok {rc=0} 14:13:10.861682 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30332): Process ended prematurely: osmo-stp_10.42.42.5(pid=30332) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30332)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:13:10.871476 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 14:13:10.898907 run osmo-hlr_10.42.42.2(pid=30329): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30329)] 14:13:10.946584 run osmo-hlr_10.42.42.2(pid=30329): stdout: | (launched: 2022-12-13_14:13:07.647920) 14:13:10.996163 run osmo-hlr_10.42.42.2(pid=30329): stderr: | 20221213141307824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141307824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141307824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141307824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141307824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141307824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141307836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141307844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141307844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141307844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:11.045948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30322): Terminating (SIGTERM) 14:13:11.086121 run iperf3-srv_10.42.42.10(pid=30323): Terminating (SIGTERM) 14:13:11.126166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30324): Terminating (SIGTERM) 14:13:11.166267 run iperf3-srv_10.42.42.10(pid=30325): Terminating (SIGTERM) 14:13:11.206164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30328): Terminating (SIGTERM) 14:13:11.246231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30331): Terminating (SIGTERM) 14:13:11.286338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30334): Terminating (SIGTERM) 14:13:11.326629 --- ParallelTerminationStrategy: PID 30322 died... 14:13:11.346282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30322): Terminated: ok {rc=0} 14:13:11.390643 --- ParallelTerminationStrategy: PID 30323 died... 14:13:11.409499 run iperf3-srv_10.42.42.10(pid=30323): Terminated {rc=256} 14:13:11.453470 --- ParallelTerminationStrategy: PID 30324 died... 14:13:11.472364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30324): Terminated: ok {rc=0} 14:13:11.516697 --- ParallelTerminationStrategy: PID 30325 died... 14:13:11.535546 run iperf3-srv_10.42.42.10(pid=30325): Terminated {rc=256} 14:13:11.579431 --- ParallelTerminationStrategy: PID 30328 died... 14:13:11.598203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30328): Terminated: ok {rc=0} 14:13:11.642160 --- ParallelTerminationStrategy: PID 30331 died... 14:13:11.660622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30331): Terminated: ok {rc=0} 14:13:11.704672 --- ParallelTerminationStrategy: PID 30334 died... 14:13:11.723498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30334): Terminated: ok {rc=0} 14:13:11.806880 bus /gobi_0: Setting Powered False 14:13:12.905475 bus /gobi_0: Setting Powered False 14:13:14.022065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:13:15.172853 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.185094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:13:15.257360 tst iperf3.py: using LAC 34495 14:13:15.385548 tst iperf3.py: using RAC 70 14:13:15.508610 tst iperf3.py: using CellId 34495 14:13:15.628625 tst iperf3.py: using BVCI 34496 14:13:15.739928 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.751111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.761963 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.772707 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.783668 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.794512 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.805396 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.816037 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:15.827006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:15.952461 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:13:16.162530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:16.479996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30336): Launched 14:13:16.845193 run iperf3-srv_10.42.42.10(pid=30337): Launched 14:13:16.981221 tst iperf3.py:8: start network... 14:13:17.192012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:17.672772 run create_hlr_db(pid=30338): Launched 14:13:17.798597 bus /gobi_6: Setting Powered False 14:13:18.860104 run create_hlr_db(pid=30338): Terminated: ok {rc=0} 14:13:19.310969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30340): Launched 14:13:19.643383 run osmo-hlr_10.42.42.2(pid=30341): Launched 14:13:19.771940 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:20.347535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30343): Launched 14:13:20.679726 run osmo-stp_10.42.42.5(pid=30344): Launched 14:13:20.806694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:13:21.378257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30346): Launched 14:13:21.504910 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:13:21.786046 run patchelf(pid=30347): Launched 14:13:21.971456 run osmo-stp_10.42.42.5(pid=30344): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30344)] 14:13:22.111216 run osmo-stp_10.42.42.5(pid=30344): stdout: | (launched: 2022-12-13_14:13:20.618089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:22.253037 run osmo-stp_10.42.42.5(pid=30344): stderr: | 20221213141320809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141320809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141320810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141320810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141320811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141320811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141320811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:22.394411 run osmo-stp_10.42.42.5(pid=30344): stdout: | (launched: 2022-12-13_14:13:20.618089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:22.529568 run osmo-stp_10.42.42.5(pid=30344): stderr: | 20221213141320809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141320809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141320810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141320810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141320811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141320811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141320811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:22.689613 run patchelf(pid=30347): Terminating (SIGINT) 14:13:22.875480 run patchelf(pid=30347): Terminated: ok {rc=0} 14:13:23.009407 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30344): Process ended prematurely: osmo-stp_10.42.42.5(pid=30344) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30344)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 14:13:23.019716 tst iperf3.py:8: Test FAILED (7.9 sec) 14:13:23.048369 run osmo-hlr_10.42.42.2(pid=30341): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30341)] 14:13:23.099420 run osmo-hlr_10.42.42.2(pid=30341): stdout: | (launched: 2022-12-13_14:13:19.581855) 14:13:23.151457 run osmo-hlr_10.42.42.2(pid=30341): stderr: | 20221213141319781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141319781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141319781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141319781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141319781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141319781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141319794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141319803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141319803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141319803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:23.204050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30336): Terminating (SIGTERM) 14:13:23.246421 run iperf3-srv_10.42.42.10(pid=30337): Terminating (SIGTERM) 14:13:23.288715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30340): Terminating (SIGTERM) 14:13:23.331032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30343): Terminating (SIGTERM) 14:13:23.373135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30346): Terminating (SIGTERM) 14:13:23.415775 --- ParallelTerminationStrategy: PID 30336 died... 14:13:23.436422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30336): Terminated: ok {rc=0} 14:13:23.482944 --- ParallelTerminationStrategy: PID 30337 died... 14:13:23.502821 run iperf3-srv_10.42.42.10(pid=30337): Terminated {rc=256} 14:13:23.548933 --- ParallelTerminationStrategy: PID 30340 died... 14:13:23.569018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30340): Terminated: ok {rc=0} 14:13:23.614895 --- ParallelTerminationStrategy: PID 30343 died... 14:13:23.635273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30343): Terminated: ok {rc=0} 14:13:23.681609 --- ParallelTerminationStrategy: PID 30346 died... 14:13:23.701639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30346): Terminated: ok {rc=0} 14:13:23.790336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:13:24.941425 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:24.953575 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:13:25.022554 tst iperf3m4.py: using LAC 34496 14:13:25.151671 tst iperf3m4.py: using RAC 71 14:13:25.281393 tst iperf3m4.py: using CellId 34496 14:13:25.412134 tst iperf3m4.py: using BVCI 34497 14:13:25.526971 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.538283 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.549406 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.560398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.571366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.582555 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.593578 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.604349 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:25.615430 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:25.737322 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:25.858814 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:25.979589 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:26.101700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:13:26.325812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:26.658838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30348): Launched 14:13:26.948280 run iperf3-srv_10.42.42.10(pid=30349): Launched 14:13:27.074845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:13:27.299238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:27.632676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Launched 14:13:27.923070 run iperf3-srv_10.42.42.10(pid=30351): Launched 14:13:28.047437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:13:28.270448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:28.603493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Launched 14:13:28.892050 run iperf3-srv_10.42.42.10(pid=30353): Launched 14:13:29.017871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:13:29.240599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:13:29.580109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30362): Launched 14:13:29.853541 run iperf3-srv_10.42.42.10(pid=30363): Launched 14:13:29.970891 tst iperf3m4.py:8: start network... 14:13:30.179241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:30.662524 run create_hlr_db(pid=30364): Launched 14:13:30.788083 bus /gobi_6: Setting Powered False 14:13:31.879839 run create_hlr_db(pid=30364): Terminated: ok {rc=0} 14:13:32.382222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30366): Launched 14:13:32.693152 run osmo-hlr_10.42.42.2(pid=30367): Launched 14:13:32.810144 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:33.343729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30369): Launched 14:13:33.656813 run osmo-stp_10.42.42.5(pid=30370): Launched 14:13:33.773856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:13:34.306626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30372): Launched 14:13:34.425182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:13:34.687391 run patchelf(pid=30373): Launched 14:13:34.860152 run osmo-stp_10.42.42.5(pid=30370): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30370)] 14:13:34.990518 run osmo-stp_10.42.42.5(pid=30370): stdout: | (launched: 2022-12-13_14:13:33.597695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:35.122327 run osmo-stp_10.42.42.5(pid=30370): stderr: | 20221213141333770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141333770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141333770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141333770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141333771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141333771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141333771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:35.253867 run osmo-stp_10.42.42.5(pid=30370): stdout: | (launched: 2022-12-13_14:13:33.597695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:35.379838 run osmo-stp_10.42.42.5(pid=30370): stderr: | 20221213141333770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141333770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141333770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141333770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141333771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141333771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141333771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:35.528839 run patchelf(pid=30373): Terminating (SIGINT) 14:13:35.702552 run patchelf(pid=30373): Terminated: ok {rc=0} 14:13:35.827227 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30370): Process ended prematurely: osmo-stp_10.42.42.5(pid=30370) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30370)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:13:35.836883 tst iperf3m4.py:8: Test FAILED (10.9 sec) 14:13:35.864359 run osmo-hlr_10.42.42.2(pid=30367): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30367)] 14:13:35.911998 run osmo-hlr_10.42.42.2(pid=30367): stdout: | (launched: 2022-12-13_14:13:32.634687) 14:13:35.961317 run osmo-hlr_10.42.42.2(pid=30367): stderr: | 20221213141332811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141332811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141332812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141332812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141332812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141332812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141332824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141332834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141332834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141332834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:36.010948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30348): Terminating (SIGTERM) 14:13:36.051405 run iperf3-srv_10.42.42.10(pid=30349): Terminating (SIGTERM) 14:13:36.091937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Terminating (SIGTERM) 14:13:36.131831 run iperf3-srv_10.42.42.10(pid=30351): Terminating (SIGTERM) 14:13:36.171821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminating (SIGTERM) 14:13:36.212094 run iperf3-srv_10.42.42.10(pid=30353): Terminating (SIGTERM) 14:13:36.251645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30362): Terminating (SIGTERM) 14:13:36.291851 run iperf3-srv_10.42.42.10(pid=30363): Terminating (SIGTERM) 14:13:36.331476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30366): Terminating (SIGTERM) 14:13:36.371098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30369): Terminating (SIGTERM) 14:13:36.411096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30372): Terminating (SIGTERM) 14:13:36.452058 --- ParallelTerminationStrategy: PID 30348 died... 14:13:36.471287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30348): Terminated: ok {rc=0} 14:13:36.515221 --- ParallelTerminationStrategy: PID 30349 died... 14:13:36.533954 run iperf3-srv_10.42.42.10(pid=30349): Terminated {rc=256} 14:13:36.577991 --- ParallelTerminationStrategy: PID 30350 died... 14:13:36.596734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30350): Terminated: ok {rc=0} 14:13:36.640688 --- ParallelTerminationStrategy: PID 30351 died... 14:13:36.659545 run iperf3-srv_10.42.42.10(pid=30351): Terminated {rc=256} 14:13:36.703512 --- ParallelTerminationStrategy: PID 30352 died... 14:13:36.722178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminated: ok {rc=0} 14:13:36.766054 --- ParallelTerminationStrategy: PID 30353 died... 14:13:36.784790 run iperf3-srv_10.42.42.10(pid=30353): Terminated {rc=256} 14:13:36.828301 --- ParallelTerminationStrategy: PID 30362 died... 14:13:36.847156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30362): Terminated: ok {rc=0} 14:13:36.890972 --- ParallelTerminationStrategy: PID 30363 died... 14:13:36.909614 run iperf3-srv_10.42.42.10(pid=30363): Terminated {rc=256} 14:13:36.953147 --- ParallelTerminationStrategy: PID 30366 died... 14:13:36.971883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30366): Terminated: ok {rc=0} 14:13:37.015668 --- ParallelTerminationStrategy: PID 30369 died... 14:13:37.034416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30369): Terminated: ok {rc=0} 14:13:37.078471 --- ParallelTerminationStrategy: PID 30372 died... 14:13:37.097429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30372): Terminated: ok {rc=0} 14:13:37.183738 bus /gobi_4: Setting Powered False 14:13:38.283116 bus /gobi_4: Setting Powered False 14:13:39.400156 bus /gobi_1: Setting Powered False 14:13:40.501366 bus /gobi_1: Setting Powered False 14:13:41.620576 bus /gobi_0: Setting Powered False 14:13:42.720887 bus /gobi_0: Setting Powered False 14:13:43.837917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:13:44.943327 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:44.955873 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:13:45.025585 tst ping.py: using LAC 34497 14:13:45.154520 tst ping.py: using RAC 72 14:13:45.281914 tst ping.py: using CellId 34497 14:13:45.411901 tst ping.py: using BVCI 34498 14:13:45.530382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.542112 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.553581 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.565017 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.576601 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.588399 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.600202 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:45.611912 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:45.733076 tst ping.py:19: start network... 14:13:45.967393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:46.482739 run create_hlr_db(pid=30374): Launched 14:13:46.634409 bus /gobi_6: Setting Powered False 14:13:47.694824 run create_hlr_db(pid=30374): Terminated: ok {rc=0} 14:13:48.143575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Launched 14:13:48.471505 run osmo-hlr_10.42.42.2(pid=30377): Launched 14:13:48.597055 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:49.164210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Launched 14:13:49.490186 run osmo-stp_10.42.42.5(pid=30380): Launched 14:13:49.613103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:13:50.174105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30382): Launched 14:13:50.300674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:13:50.576850 run patchelf(pid=30383): Launched 14:13:50.759115 run osmo-stp_10.42.42.5(pid=30380): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] 14:13:50.896276 run osmo-stp_10.42.42.5(pid=30380): stdout: | (launched: 2022-12-13_14:13:49.429304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:51.035761 run osmo-stp_10.42.42.5(pid=30380): stderr: | 20221213141349622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141349622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141349622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141349623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141349623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141349624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141349624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:51.175270 run osmo-stp_10.42.42.5(pid=30380): stdout: | (launched: 2022-12-13_14:13:49.429304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:51.308792 run osmo-stp_10.42.42.5(pid=30380): stderr: | 20221213141349622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141349622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141349622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141349623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141349623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141349624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141349624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:51.466041 run patchelf(pid=30383): Terminating (SIGINT) 14:13:51.648698 run patchelf(pid=30383): Terminated: ok {rc=0} 14:13:51.780225 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30380): Process ended prematurely: osmo-stp_10.42.42.5(pid=30380) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 14:13:51.790431 tst ping.py:22: Test FAILED (6.8 sec) 14:13:51.818918 run osmo-hlr_10.42.42.2(pid=30377): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30377)] 14:13:51.869772 run osmo-hlr_10.42.42.2(pid=30377): stdout: | (launched: 2022-12-13_14:13:48.410979) 14:13:51.921818 run osmo-hlr_10.42.42.2(pid=30377): stderr: | 20221213141348609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141348609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141348609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141348609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141348609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141348609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141348622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141348630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141348630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141348630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:51.974229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Terminating (SIGTERM) 14:13:52.015985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Terminating (SIGTERM) 14:13:52.058131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30382): Terminating (SIGTERM) 14:13:52.101043 --- ParallelTerminationStrategy: PID 30376 died... 14:13:52.121678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Terminated: ok {rc=0} 14:13:52.168818 --- ParallelTerminationStrategy: PID 30379 died... 14:13:52.189082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Terminated: ok {rc=0} 14:13:52.235877 --- ParallelTerminationStrategy: PID 30382 died... 14:13:52.256378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30382): Terminated: ok {rc=0} 14:13:52.346383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:13:53.434312 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:53.446931 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:13:53.522354 tst ping_idle_ping.py: using LAC 34498 14:13:53.642272 tst ping_idle_ping.py: using RAC 73 14:13:53.762585 tst ping_idle_ping.py: using CellId 34498 14:13:53.882655 tst ping_idle_ping.py: using BVCI 34499 14:13:53.994392 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.005715 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.016673 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.027596 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.038471 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.049391 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.060333 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:13:54.071273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:13:54.186071 tst ping_idle_ping.py:24: start network... 14:13:54.390088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:54.867643 run create_hlr_db(pid=30384): Launched 14:13:54.992026 bus /gobi_6: Setting Powered False 14:13:56.052373 run create_hlr_db(pid=30384): Terminated: ok {rc=0} 14:13:56.500168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Launched 14:13:56.828762 run osmo-hlr_10.42.42.2(pid=30387): Launched 14:13:56.953849 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:57.520836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Launched 14:13:57.848108 run osmo-stp_10.42.42.5(pid=30390): Launched 14:13:57.973108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:13:58.536047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Launched 14:13:58.662571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:13:58.939122 run patchelf(pid=30393): Launched 14:13:59.120823 run osmo-stp_10.42.42.5(pid=30390): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] 14:13:59.259277 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-13_14:13:57.787415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:59.399626 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221213141357980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141357981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141357981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141357981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141357982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141357982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141357982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:59.539649 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-13_14:13:57.787415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:59.673259 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221213141357980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141357981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141357981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141357981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141357982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141357982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141357982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:59.831648 run patchelf(pid=30393): Terminating (SIGINT) 14:14:00.014982 run patchelf(pid=30393): Terminated: ok {rc=0} 14:14:00.147031 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30390): Process ended prematurely: osmo-stp_10.42.42.5(pid=30390) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:14:00.156850 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:14:00.185429 run osmo-hlr_10.42.42.2(pid=30387): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30387)] 14:14:00.236609 run osmo-hlr_10.42.42.2(pid=30387): stdout: | (launched: 2022-12-13_14:13:56.768169) 14:14:00.289427 run osmo-hlr_10.42.42.2(pid=30387): stderr: | 20221213141356966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141356966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141356966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141356966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141356966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141356966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141356980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141356988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141356989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141356989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:00.342416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminating (SIGTERM) 14:14:00.384494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminating (SIGTERM) 14:14:00.427257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminating (SIGTERM) 14:14:00.470336 --- ParallelTerminationStrategy: PID 30386 died... 14:14:00.490874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminated: ok {rc=0} 14:14:00.537808 --- ParallelTerminationStrategy: PID 30389 died... 14:14:00.558012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminated: ok {rc=0} 14:14:00.604772 --- ParallelTerminationStrategy: PID 30392 died... 14:14:00.625374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminated: ok {rc=0} 14:14:00.713985 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:14:02.034934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:02.043066 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:14:02.080411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 14:14:02.121731 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 14:14:02.209395 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:14:02.242036 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 14:14:02.280889 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 14:14:02.882796 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 14:14:02.933306 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:02.944505 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:14:02.992933 tst cs_paging_gprs_active.py: using LAC 34499 14:14:03.112635 tst cs_paging_gprs_active.py: using RAC 74 14:14:03.232614 tst cs_paging_gprs_active.py: using CellId 34499 14:14:03.353693 tst cs_paging_gprs_active.py: using BVCI 34500 14:14:03.467522 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.479084 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.490359 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.501660 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.513460 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.525191 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.537178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.548844 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:03.560850 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:03.684227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:03.803778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:14:04.010718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:04.320152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30397): Launched 14:14:04.589160 run iperf3-srv_10.42.42.10(pid=30398): Launched 14:14:04.705272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:14:04.910470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:05.219524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30399): Launched 14:14:05.489165 run iperf3-srv_10.42.42.10(pid=30400): Launched 14:14:05.605630 tst cs_paging_gprs_active.py:38: start network... 14:14:05.814224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:06.298999 run create_hlr_db(pid=30401): Launched 14:14:06.427141 bus /gobi_6: Setting Powered False 14:14:07.487839 run create_hlr_db(pid=30401): Terminated: ok {rc=0} 14:14:07.919426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Launched 14:14:08.227279 run osmo-hlr_10.42.42.2(pid=30404): Launched 14:14:08.344805 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:08.881119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Launched 14:14:09.190065 run osmo-stp_10.42.42.5(pid=30407): Launched 14:14:09.307189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:14:09.837678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Launched 14:14:09.955424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:14:10.216859 run patchelf(pid=30410): Launched 14:14:10.388789 run osmo-stp_10.42.42.5(pid=30407): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] 14:14:10.518696 run osmo-stp_10.42.42.5(pid=30407): stdout: | (launched: 2022-12-13_14:14:09.132614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:10.650739 run osmo-stp_10.42.42.5(pid=30407): stderr: | 20221213141409303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141409303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141409303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141409304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141409304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141409304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141409304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:10.783271 run osmo-stp_10.42.42.5(pid=30407): stdout: | (launched: 2022-12-13_14:14:09.132614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:10.909229 run osmo-stp_10.42.42.5(pid=30407): stderr: | 20221213141409303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141409303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141409303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141409304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141409304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141409304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141409304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:11.057912 run patchelf(pid=30410): Terminating (SIGINT) 14:14:11.230205 run patchelf(pid=30410): Terminated: ok {rc=0} 14:14:11.354655 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30407): Process ended prematurely: osmo-stp_10.42.42.5(pid=30407) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 14:14:11.364215 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:14:11.391359 run osmo-hlr_10.42.42.2(pid=30404): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30404)] 14:14:11.438936 run osmo-hlr_10.42.42.2(pid=30404): stdout: | (launched: 2022-12-13_14:14:08.170255) 14:14:11.488373 run osmo-hlr_10.42.42.2(pid=30404): stderr: | 20221213141408346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141408346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141408346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141408346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141408346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141408346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141408359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141408367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141408367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141408367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:11.538417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30397): Terminating (SIGTERM) 14:14:11.578200 run iperf3-srv_10.42.42.10(pid=30398): Terminating (SIGTERM) 14:14:11.618554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30399): Terminating (SIGTERM) 14:14:11.658508 run iperf3-srv_10.42.42.10(pid=30400): Terminating (SIGTERM) 14:14:11.698674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Terminating (SIGTERM) 14:14:11.738886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Terminating (SIGTERM) 14:14:11.779386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Terminating (SIGTERM) 14:14:11.819809 --- ParallelTerminationStrategy: PID 30397 died... 14:14:11.838970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30397): Terminated: ok {rc=0} 14:14:11.882870 --- ParallelTerminationStrategy: PID 30398 died... 14:14:11.901998 run iperf3-srv_10.42.42.10(pid=30398): Terminated {rc=256} 14:14:11.946420 --- ParallelTerminationStrategy: PID 30399 died... 14:14:11.965107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30399): Terminated: ok {rc=0} 14:14:12.008675 --- ParallelTerminationStrategy: PID 30400 died... 14:14:12.027211 run iperf3-srv_10.42.42.10(pid=30400): Terminated {rc=256} 14:14:12.070989 --- ParallelTerminationStrategy: PID 30403 died... 14:14:12.089715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Terminated: ok {rc=0} 14:14:12.133410 --- ParallelTerminationStrategy: PID 30406 died... 14:14:12.152117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Terminated: ok {rc=0} 14:14:12.195850 --- ParallelTerminationStrategy: PID 30409 died... 14:14:12.214599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Terminated: ok {rc=0} 14:14:12.300194 bus /gobi_0: Setting Powered False 14:14:13.400523 bus /gobi_0: Setting Powered False 14:14:14.515760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 14:14:15.662849 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:15.675345 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:14:15.725710 tst iperf3.py: using LAC 34500 14:14:15.876396 tst iperf3.py: using RAC 75 14:14:16.006067 tst iperf3.py: using CellId 34500 14:14:16.133700 tst iperf3.py: using BVCI 34501 14:14:16.257759 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.270880 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.283689 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.296519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.310514 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.325125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.339179 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.353138 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:16.367287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:16.494938 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:14:16.706142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:17.022456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30411): Launched 14:14:17.346405 run iperf3-srv_10.42.42.10(pid=30412): Launched 14:14:17.470264 tst iperf3.py:8: start network... 14:14:17.691203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:18.200131 run create_hlr_db(pid=30413): Launched 14:14:18.327920 bus /gobi_6: Setting Powered False 14:14:19.393076 run create_hlr_db(pid=30413): Terminated: ok {rc=0} 14:14:19.832312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30415): Launched 14:14:20.141299 run osmo-hlr_10.42.42.2(pid=30416): Launched 14:14:20.258135 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:20.804006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30418): Launched 14:14:21.114314 run osmo-stp_10.42.42.5(pid=30419): Launched 14:14:21.232208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:14:21.763657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30421): Launched 14:14:21.882498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:14:22.143005 run patchelf(pid=30422): Launched 14:14:22.314965 run osmo-stp_10.42.42.5(pid=30419): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30419)] 14:14:22.445262 run osmo-stp_10.42.42.5(pid=30419): stdout: | (launched: 2022-12-13_14:14:21.056450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:22.577080 run osmo-stp_10.42.42.5(pid=30419): stderr: | 20221213141421226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141421226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141421226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141421227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141421227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141421227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141421227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:22.708938 run osmo-stp_10.42.42.5(pid=30419): stdout: | (launched: 2022-12-13_14:14:21.056450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:22.835634 run osmo-stp_10.42.42.5(pid=30419): stderr: | 20221213141421226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141421226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141421226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141421227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141421227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141421227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141421227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:22.985176 run patchelf(pid=30422): Terminating (SIGINT) 14:14:23.158677 run patchelf(pid=30422): Terminated: ok {rc=0} 14:14:23.283400 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30419): Process ended prematurely: osmo-stp_10.42.42.5(pid=30419) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30419)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 14:14:23.293175 tst iperf3.py:8: Test FAILED (7.7 sec) 14:14:23.320158 run osmo-hlr_10.42.42.2(pid=30416): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30416)] 14:14:23.367726 run osmo-hlr_10.42.42.2(pid=30416): stdout: | (launched: 2022-12-13_14:14:20.083770) 14:14:23.417257 run osmo-hlr_10.42.42.2(pid=30416): stderr: | 20221213141420262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141420262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141420262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141420262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141420262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141420263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141420275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141420286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141420286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141420286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:23.467104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30411): Terminating (SIGTERM) 14:14:23.506819 run iperf3-srv_10.42.42.10(pid=30412): Terminating (SIGTERM) 14:14:23.546635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30415): Terminating (SIGTERM) 14:14:23.586277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30418): Terminating (SIGTERM) 14:14:23.625856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30421): Terminating (SIGTERM) 14:14:23.665817 --- ParallelTerminationStrategy: PID 30411 died... 14:14:23.684833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30411): Terminated: ok {rc=0} 14:14:23.728538 --- ParallelTerminationStrategy: PID 30412 died... 14:14:23.746913 run iperf3-srv_10.42.42.10(pid=30412): Terminated {rc=256} 14:14:23.790426 --- ParallelTerminationStrategy: PID 30415 died... 14:14:23.809064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30415): Terminated: ok {rc=0} 14:14:23.852938 --- ParallelTerminationStrategy: PID 30418 died... 14:14:23.871516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30418): Terminated: ok {rc=0} 14:14:23.915117 --- ParallelTerminationStrategy: PID 30421 died... 14:14:23.933638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30421): Terminated: ok {rc=0} 14:14:24.019575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 14:14:25.172933 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.185723 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:14:25.241424 tst iperf3m4.py: using LAC 34501 14:14:25.372296 tst iperf3m4.py: using RAC 76 14:14:25.502119 tst iperf3m4.py: using CellId 34501 14:14:25.630913 tst iperf3m4.py: using BVCI 34502 14:14:25.752390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.764286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.776148 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.788021 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.800038 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.812013 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.824219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.836354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:25.848798 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:25.971588 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:26.094865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:26.217484 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:26.336549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:14:26.561625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:26.892137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30423): Launched 14:14:27.182092 run iperf3-srv_10.42.42.10(pid=30424): Launched 14:14:27.308573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:14:27.530477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:27.862434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30425): Launched 14:14:28.150000 run iperf3-srv_10.42.42.10(pid=30426): Launched 14:14:28.276496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:14:28.499520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:28.831982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30427): Launched 14:14:29.120568 run iperf3-srv_10.42.42.10(pid=30428): Launched 14:14:29.245746 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:14:29.467927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:14:29.798356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30429): Launched 14:14:30.085122 run iperf3-srv_10.42.42.10(pid=30430): Launched 14:14:30.210400 tst iperf3m4.py:8: start network... 14:14:30.432256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:30.949678 run create_hlr_db(pid=30432): Launched 14:14:31.128621 bus /gobi_6: Setting Powered False 14:14:32.197445 run create_hlr_db(pid=30432): Terminated: ok {rc=0} 14:14:32.655612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30434): Launched 14:14:32.985576 run osmo-hlr_10.42.42.2(pid=30435): Launched 14:14:33.111790 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:33.682337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30437): Launched 14:14:34.014284 run osmo-stp_10.42.42.5(pid=30438): Launched 14:14:34.142117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:14:34.710691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30440): Launched 14:14:34.837527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:14:35.116774 run patchelf(pid=30441): Launched 14:14:35.300903 run osmo-stp_10.42.42.5(pid=30438): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30438)] 14:14:35.440137 run osmo-stp_10.42.42.5(pid=30438): stdout: | (launched: 2022-12-13_14:14:33.953030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:35.580621 run osmo-stp_10.42.42.5(pid=30438): stderr: | 20221213141434146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141434146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141434146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141434147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141434147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141434147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141434147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:35.721527 run osmo-stp_10.42.42.5(pid=30438): stdout: | (launched: 2022-12-13_14:14:33.953030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:35.855899 run osmo-stp_10.42.42.5(pid=30438): stderr: | 20221213141434146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141434146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141434146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141434147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141434147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141434147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141434147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:36.015809 run patchelf(pid=30441): Terminating (SIGINT) 14:14:36.200643 run patchelf(pid=30441): Terminated: ok {rc=0} 14:14:36.334360 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30438): Process ended prematurely: osmo-stp_10.42.42.5(pid=30438) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30438)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 14:14:36.344822 tst iperf3m4.py:8: Test FAILED (11.2 sec) 14:14:36.373933 run osmo-hlr_10.42.42.2(pid=30435): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30435)] 14:14:36.425742 run osmo-hlr_10.42.42.2(pid=30435): stdout: | (launched: 2022-12-13_14:14:32.924482) 14:14:36.478088 run osmo-hlr_10.42.42.2(pid=30435): stderr: | 20221213141433125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141433125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141433125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141433125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141433125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141433125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141433139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141433147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141433148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141433148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:36.530866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30423): Terminating (SIGTERM) 14:14:36.573066 run iperf3-srv_10.42.42.10(pid=30424): Terminating (SIGTERM) 14:14:36.615568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30425): Terminating (SIGTERM) 14:14:36.658049 run iperf3-srv_10.42.42.10(pid=30426): Terminating (SIGTERM) 14:14:36.700441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30427): Terminating (SIGTERM) 14:14:36.742925 run iperf3-srv_10.42.42.10(pid=30428): Terminating (SIGTERM) 14:14:36.785207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30429): Terminating (SIGTERM) 14:14:36.827346 run iperf3-srv_10.42.42.10(pid=30430): Terminating (SIGTERM) 14:14:36.869383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30434): Terminating (SIGTERM) 14:14:36.911998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30437): Terminating (SIGTERM) 14:14:36.954235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30440): Terminating (SIGTERM) 14:14:36.997141 --- ParallelTerminationStrategy: PID 30423 died... 14:14:37.017709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30423): Terminated: ok {rc=0} 14:14:37.064520 --- ParallelTerminationStrategy: PID 30424 died... 14:14:37.084490 run iperf3-srv_10.42.42.10(pid=30424): Terminated {rc=256} 14:14:37.131059 --- ParallelTerminationStrategy: PID 30425 died... 14:14:37.151240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30425): Terminated: ok {rc=0} 14:14:37.197887 --- ParallelTerminationStrategy: PID 30426 died... 14:14:37.217952 run iperf3-srv_10.42.42.10(pid=30426): Terminated {rc=256} 14:14:37.265025 --- ParallelTerminationStrategy: PID 30427 died... 14:14:37.285015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30427): Terminated: ok {rc=0} 14:14:37.331539 --- ParallelTerminationStrategy: PID 30428 died... 14:14:37.351634 run iperf3-srv_10.42.42.10(pid=30428): Terminated {rc=256} 14:14:37.398115 --- ParallelTerminationStrategy: PID 30429 died... 14:14:37.418137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30429): Terminated: ok {rc=0} 14:14:37.464387 --- ParallelTerminationStrategy: PID 30430 died... 14:14:37.484448 run iperf3-srv_10.42.42.10(pid=30430): Terminated {rc=256} 14:14:37.531018 --- ParallelTerminationStrategy: PID 30434 died... 14:14:37.550994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30434): Terminated: ok {rc=0} 14:14:37.597688 --- ParallelTerminationStrategy: PID 30437 died... 14:14:37.617826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30437): Terminated: ok {rc=0} 14:14:37.664534 --- ParallelTerminationStrategy: PID 30440 died... 14:14:37.684572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30440): Terminated: ok {rc=0} 14:14:37.773976 bus /gobi_4: Setting Powered False 14:14:38.873575 bus /gobi_4: Setting Powered False 14:14:39.990069 bus /gobi_1: Setting Powered False 14:14:41.089417 bus /gobi_1: Setting Powered False 14:14:42.207026 bus /gobi_0: Setting Powered False 14:14:43.307013 bus /gobi_0: Setting Powered False 14:14:44.427320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 14:14:45.531329 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:45.543602 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:14:45.595659 tst ping.py: using LAC 34502 14:14:45.716418 tst ping.py: using RAC 77 14:14:45.835820 tst ping.py: using CellId 34502 14:14:45.987777 tst ping.py: using BVCI 34503 14:14:46.114000 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.127083 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.139959 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.153402 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.166610 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.180471 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.194337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:46.208151 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:46.327503 tst ping.py:19: start network... 14:14:46.551511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:47.066400 run create_hlr_db(pid=30442): Launched 14:14:47.230277 bus /gobi_6: Setting Powered False 14:14:48.294586 run create_hlr_db(pid=30442): Terminated: ok {rc=0} 14:14:48.747196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30444): Launched 14:14:49.071238 run osmo-hlr_10.42.42.2(pid=30445): Launched 14:14:49.196262 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:49.758771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30447): Launched 14:14:50.083819 run osmo-stp_10.42.42.5(pid=30448): Launched 14:14:50.207604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:14:50.766442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30450): Launched 14:14:50.890250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:14:51.163623 run patchelf(pid=30451): Launched 14:14:51.344729 run osmo-stp_10.42.42.5(pid=30448): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30448)] 14:14:51.481488 run osmo-stp_10.42.42.5(pid=30448): stdout: | (launched: 2022-12-13_14:14:50.023705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:51.619916 run osmo-stp_10.42.42.5(pid=30448): stderr: | 20221213141450216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141450216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141450216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141450217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141450217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141450217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141450217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:51.759064 run osmo-stp_10.42.42.5(pid=30448): stdout: | (launched: 2022-12-13_14:14:50.023705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:51.891480 run osmo-stp_10.42.42.5(pid=30448): stderr: | 20221213141450216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141450216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141450216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141450217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141450217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141450217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141450217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:52.048283 run patchelf(pid=30451): Terminating (SIGINT) 14:14:52.230336 run patchelf(pid=30451): Terminated: ok {rc=0} 14:14:52.361986 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30448): Process ended prematurely: osmo-stp_10.42.42.5(pid=30448) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30448)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 14:14:52.371714 tst ping.py:22: Test FAILED (6.8 sec) 14:14:52.399879 run osmo-hlr_10.42.42.2(pid=30445): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30445)] 14:14:52.450920 run osmo-hlr_10.42.42.2(pid=30445): stdout: | (launched: 2022-12-13_14:14:49.011154) 14:14:52.503148 run osmo-hlr_10.42.42.2(pid=30445): stderr: | 20221213141449208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141449208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141449208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141449208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141449208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141449208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141449224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141449232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141449232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141449232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:52.555819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30444): Terminating (SIGTERM) 14:14:52.597696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30447): Terminating (SIGTERM) 14:14:52.639987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30450): Terminating (SIGTERM) 14:14:52.682554 --- ParallelTerminationStrategy: PID 30444 died... 14:14:52.702787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30444): Terminated: ok {rc=0} 14:14:52.749770 --- ParallelTerminationStrategy: PID 30447 died... 14:14:52.769674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30447): Terminated: ok {rc=0} 14:14:52.816375 --- ParallelTerminationStrategy: PID 30450 died... 14:14:52.836531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30450): Terminated: ok {rc=0} 14:14:52.925321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 14:14:54.013351 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.025606 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:14:54.084899 tst ping_idle_ping.py: using LAC 34503 14:14:54.212351 tst ping_idle_ping.py: using RAC 78 14:14:54.338124 tst ping_idle_ping.py: using CellId 34503 14:14:54.463193 tst ping_idle_ping.py: using BVCI 34504 14:14:54.580739 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.593079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.605088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.616930 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.629021 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.641012 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.653361 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:14:54.665690 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:14:54.782936 tst ping_idle_ping.py:24: start network... 14:14:54.986158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:55.461629 run create_hlr_db(pid=30452): Launched 14:14:55.587290 bus /gobi_6: Setting Powered False 14:14:56.647370 run create_hlr_db(pid=30452): Terminated: ok {rc=0} 14:14:57.093674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Launched 14:14:57.421663 run osmo-hlr_10.42.42.2(pid=30455): Launched 14:14:57.545839 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:58.110190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Launched 14:14:58.435330 run osmo-stp_10.42.42.5(pid=30458): Launched 14:14:58.560280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:14:59.119807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30460): Launched 14:14:59.244848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:14:59.520751 run patchelf(pid=30461): Launched 14:14:59.701825 run osmo-stp_10.42.42.5(pid=30458): ERR: Terminated: ERROR {rc=1} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] 14:14:59.838898 run osmo-stp_10.42.42.5(pid=30458): stdout: | (launched: 2022-12-13_14:14:58.375205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:59.977680 run osmo-stp_10.42.42.5(pid=30458): stderr: | 20221213141458566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141458566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141458567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141458567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141458568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141458568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141458568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:00.116599 run osmo-stp_10.42.42.5(pid=30458): stdout: | (launched: 2022-12-13_14:14:58.375205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:00.249263 run osmo-stp_10.42.42.5(pid=30458): stderr: | 20221213141458566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141458566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141458567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141458567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141458568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141458568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141458568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:00.407291 run patchelf(pid=30461): Terminating (SIGINT) 14:15:00.589263 run patchelf(pid=30461): Terminated: ok {rc=0} 14:15:00.720571 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30458): Process ended prematurely: osmo-stp_10.42.42.5(pid=30458) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 14:15:00.730675 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:15:00.758962 run osmo-hlr_10.42.42.2(pid=30455): ERR: Terminated: ERROR {rc=237} [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30455)] 14:15:00.810953 run osmo-hlr_10.42.42.2(pid=30455): stdout: | (launched: 2022-12-13_14:14:57.360579) 14:15:00.865550 run osmo-hlr_10.42.42.2(pid=30455): stderr: | 20221213141457559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141457559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141457559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141457559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141457559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141457559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141457571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141457580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141457580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141457580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:00.929668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Terminating (SIGTERM) 14:15:00.973095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Terminating (SIGTERM) 14:15:01.017565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30460): Terminating (SIGTERM) 14:15:01.062326 --- ParallelTerminationStrategy: PID 30454 died... 14:15:01.084143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Terminated: ok {rc=0} 14:15:01.135847 --- ParallelTerminationStrategy: PID 30457 died... 14:15:01.156592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Terminated: ok {rc=0} 14:15:01.205573 --- ParallelTerminationStrategy: PID 30460 died... 14:15:01.226914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30460): Terminated: ok {rc=0} 14:15:01.319703 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 14:15:02.636024 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:02.643529 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:15:02.675289 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:15:02.710015 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:15:02.764385 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:15:02.797206 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:15:02.832149 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:15:03.392581 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2390 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:15:03.398690 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:03.410797 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:15:03.477677 tst switch_tch_pdch.py: using LAC 34504 14:15:03.599044 tst switch_tch_pdch.py: using RAC 79 14:15:03.718713 tst switch_tch_pdch.py: using CellId 34504 14:15:03.839817 tst switch_tch_pdch.py: using BVCI 34505 14:15:03.951106 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:03.962849 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:03.974445 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:03.986103 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:03.997692 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:04.008940 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:04.020436 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:15:04.031956 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:15:04.153152 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:15:04.272032 tst switch_tch_pdch.py:51: start network... 14:15:04.475029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:04.943135 run create_hlr_db(pid=30471): Launched 14:15:05.068352 bus /gobi_6: Setting Powered False 14:15:06.128599 run create_hlr_db(pid=30471): Terminated: ok {rc=0} 14:15:06.552453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Launched 14:15:06.855802 run osmo-hlr_10.42.42.2(pid=30474): Launched 14:15:06.971024 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:07.502449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Launched 14:15:07.806803 run osmo-stp_10.42.42.5(pid=30477): Launched 14:15:07.922164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:15:08.447163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Launched 14:15:08.564836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:15:08.822090 run patchelf(pid=30480): Launched 14:15:08.991200 run osmo-stp_10.42.42.5(pid=30477): ERR: Terminated: ERROR {rc=1} [trial-2390↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30477)] 14:15:09.120244 run osmo-stp_10.42.42.5(pid=30477): stdout: | (launched: 2022-12-13_14:15:07.750385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:09.252086 run osmo-stp_10.42.42.5(pid=30477): stderr: | 20221213141507920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141507920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141507921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141507921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141507922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141507922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141507922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:09.383277 run osmo-stp_10.42.42.5(pid=30477): stdout: | (launched: 2022-12-13_14:15:07.750385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:09.507488 run osmo-stp_10.42.42.5(pid=30477): stderr: | 20221213141507920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141507920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141507921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141507921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141507922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141507922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141507922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:09.655091 run patchelf(pid=30480): Terminating (SIGINT) 14:15:09.825382 run patchelf(pid=30480): Terminated: ok {rc=0} 14:15:09.948282 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30477): Process ended prematurely: osmo-stp_10.42.42.5(pid=30477) [trial-2390↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30477)] [trial-2390↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:15:09.957443 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 14:15:09.983914 run osmo-hlr_10.42.42.2(pid=30474): ERR: Terminated: ERROR {rc=237} [trial-2390↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30474)] 14:15:10.031468 run osmo-hlr_10.42.42.2(pid=30474): stdout: | (launched: 2022-12-13_14:15:06.799344) 14:15:10.080877 run osmo-hlr_10.42.42.2(pid=30474): stderr: | 20221213141506975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141506975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141506975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141506975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141506975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141506975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141506987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141506996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141506996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141506996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:10.130663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Terminating (SIGTERM) 14:15:10.170643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Terminating (SIGTERM) 14:15:10.210509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Terminating (SIGTERM) 14:15:10.250651 --- ParallelTerminationStrategy: PID 30473 died... 14:15:10.269235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30473): Terminated: ok {rc=0} 14:15:10.313131 --- ParallelTerminationStrategy: PID 30476 died... 14:15:10.331717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30476): Terminated: ok {rc=0} 14:15:10.375581 --- ParallelTerminationStrategy: PID 30479 died... 14:15:10.394196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30479): Terminated: ok {rc=0} 14:15:10.479595 bus /gobi_0: Setting Powered False 14:15:11.579657 bus /gobi_0: Setting Powered False 14:15:12.696350 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2390 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 nitb_smpp --------------------------------------------------------------------- 14:15:13.956332 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:13.958834 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 14:15:13.979243 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 14:15:13.985927 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 14:15:14.019615 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 14:15:14.040245 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 14:15:14.046850 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 14:15:14.569589 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2390 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 14:15:14.577037 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:15:14.596894 tst esme_connect_policy_acceptall.py: using MSISDN 8193 14:15:14.741581 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:15:15.361175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30484): Launched 14:15:15.692352 run osmo-nitb_10.42.42.2(pid=30485): Launched 14:15:15.878025 run osmo-nitb_10.42.42.2(pid=30485): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30485)] 14:15:16.033346 run osmo-nitb_10.42.42.2(pid=30485): stdout: | (launched: 2022-12-13_14:15:15.631646) 14:15:16.185901 run osmo-nitb_10.42.42.2(pid=30485): stderr: | (launched: 2022-12-13_14:15:15.680658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:16.337937 run osmo-nitb_10.42.42.2(pid=30485): stdout: | (launched: 2022-12-13_14:15:15.631646) 14:15:16.483209 run osmo-nitb_10.42.42.2(pid=30485): stderr: | (launched: 2022-12-13_14:15:15.680658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30485) [trial-2390↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30485)] 14:15:16.817154 tst osmo-nitb_10.42.42.2(pid=30485): stdout: | (launched: 2022-12-13_14:15:15.631646) 14:15:16.982023 tst osmo-nitb_10.42.42.2(pid=30485): stderr: | (launched: 2022-12-13_14:15:15.680658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:17.136053 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=30485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30485) [trial-2390↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30485)] [trial-2390↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 14:15:17.145433 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.6 sec) 14:15:17.152697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30484): Terminating (SIGTERM) 14:15:17.364428 --- ParallelTerminationStrategy: PID 30484 died... 14:15:17.385436 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30484): Terminated: ok {rc=0} ---------------------------------------------- trial-2390 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 14:15:17.435226 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:15:17.456934 tst esme_connect_policy_closed.py: using MSISDN 8194 14:15:17.590180 tst esme_connect_policy_closed.py: using MSISDN 8195 14:15:17.710265 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:15:18.329740 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30486): Launched 14:15:18.664387 run osmo-nitb_10.42.42.2(pid=30487): Launched 14:15:18.842756 run osmo-nitb_10.42.42.2(pid=30487): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30487)] 14:15:18.978671 run osmo-nitb_10.42.42.2(pid=30487): stdout: | (launched: 2022-12-13_14:15:18.603374) 14:15:19.116486 run osmo-nitb_10.42.42.2(pid=30487): stderr: | (launched: 2022-12-13_14:15:18.653016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:19.255025 run osmo-nitb_10.42.42.2(pid=30487): stdout: | (launched: 2022-12-13_14:15:18.603374) 14:15:19.387145 run osmo-nitb_10.42.42.2(pid=30487): stderr: | (launched: 2022-12-13_14:15:18.653016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:19.544839 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=30487): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30487) [trial-2390↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30487)] [trial-2390↪nitb_smpp↪esme_connect_policy_closed.py:24] 14:15:19.554094 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 14:15:19.561218 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30486): Terminating (SIGTERM) 14:15:19.772528 --- ParallelTerminationStrategy: PID 30486 died... 14:15:19.794101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30486): Terminated: ok {rc=0} ---------------------------------------------- trial-2390 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 14:15:19.847862 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:15:19.859558 tst nitb_smpp: Using 1 x bts (candidates: 1) 14:15:19.897194 tst esme_ms_sms_storeforward.py: using LAC 34505 14:15:20.028775 tst esme_ms_sms_storeforward.py: using RAC 80 14:15:20.160573 tst esme_ms_sms_storeforward.py: using CellId 34505 14:15:20.290978 tst esme_ms_sms_storeforward.py: using BVCI 34506 14:15:20.412638 tst nitb_smpp: Using 1 x modem (candidates: 1) 14:15:20.541460 tst esme_ms_sms_storeforward.py: using MSISDN 8196 14:15:20.655162 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 14:15:20.864899 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:15:21.503094 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30488): Launched 14:15:21.817616 run osmo-nitb_10.42.42.2(pid=30489): Launched 14:15:21.986815 run osmo-nitb_10.42.42.2(pid=30489): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30489)] 14:15:22.115889 run osmo-nitb_10.42.42.2(pid=30489): stdout: | (launched: 2022-12-13_14:15:21.759505) 14:15:22.246470 run osmo-nitb_10.42.42.2(pid=30489): stderr: | (launched: 2022-12-13_14:15:21.806122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:22.377195 run osmo-nitb_10.42.42.2(pid=30489): stdout: | (launched: 2022-12-13_14:15:21.759505) 14:15:22.501982 run osmo-nitb_10.42.42.2(pid=30489): stderr: | (launched: 2022-12-13_14:15:21.806122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:22.650983 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=30489): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30489) [trial-2390↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30489)] [trial-2390↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 14:15:22.659842 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 14:15:22.666665 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30488): Terminating (SIGTERM) 14:15:22.875511 --- ParallelTerminationStrategy: PID 30488 died... 14:15:22.896374 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30488): Terminated: ok {rc=0} 14:15:22.982717 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:15:24.073253 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:15:24.085217 tst nitb_smpp: Using 1 x bts (candidates: 1) 14:15:24.122286 tst esme_ms_sms_transaction.py: using LAC 34506 14:15:24.257236 tst esme_ms_sms_transaction.py: using RAC 81 14:15:24.386999 tst esme_ms_sms_transaction.py: using CellId 34506 14:15:24.516758 tst esme_ms_sms_transaction.py: using BVCI 34507 14:15:24.637829 tst nitb_smpp: Using 1 x modem (candidates: 1) 14:15:24.766704 tst esme_ms_sms_transaction.py: using MSISDN 8197 14:15:24.887390 tst esme_ms_sms_transaction.py:18: start nitb and bts... 14:15:25.111489 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:15:25.786572 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30490): Launched 14:15:26.119271 run osmo-nitb_10.42.42.2(pid=30491): Launched 14:15:26.304691 run osmo-nitb_10.42.42.2(pid=30491): ERR: Terminated: ERROR {rc=2} [trial-2390↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30491)] 14:15:26.454076 run osmo-nitb_10.42.42.2(pid=30491): stdout: | (launched: 2022-12-13_14:15:26.058412) 14:15:26.603923 run osmo-nitb_10.42.42.2(pid=30491): stderr: | (launched: 2022-12-13_14:15:26.107552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:26.753315 run osmo-nitb_10.42.42.2(pid=30491): stdout: | (launched: 2022-12-13_14:15:26.058412) 14:15:26.897430 run osmo-nitb_10.42.42.2(pid=30491): stderr: | (launched: 2022-12-13_14:15:26.107552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f07f086a268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30491) [trial-2390↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30491)] 14:15:27.245633 tst osmo-nitb_10.42.42.2(pid=30491): stdout: | (launched: 2022-12-13_14:15:26.058412) 14:15:27.380559 tst osmo-nitb_10.42.42.2(pid=30491): stderr: | (launched: 2022-12-13_14:15:26.107552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:15:27.539102 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=30491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30491) [trial-2390↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30491)] [trial-2390↪nitb_smpp↪esme_ms_sms_transaction.py:21] 14:15:27.548461 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 14:15:27.555670 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30490): Terminating (SIGTERM) 14:15:27.768680 --- ParallelTerminationStrategy: PID 30490 died... 14:15:27.790323 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30490): Terminated: ok {rc=0} 14:15:27.881241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 smpp --------------------------------------------------------------------- 14:15:29.050516 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:29.053803 tst smpp: Verifying 1 x bts (candidates: 11) 14:15:29.074695 tst smpp: Verifying 6 x ip_address (candidates: 9) 14:15:29.103091 tst smpp: Verifying 1 x modem (candidates: 12) 14:15:29.138937 tst smpp: Reserving 1 x bts (candidates: 11) 14:15:29.160072 tst smpp: Reserving 6 x ip_address (candidates: 9) 14:15:29.186880 tst smpp: Reserving 1 x modem (candidates: 12) 14:15:29.715470 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 14:15:29.720668 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:29.731228 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:29.741780 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:29.752037 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:29.771827 tst esme_connect_policy_acceptall.py: using MSISDN 8198 14:15:29.886457 run osmo-stp_10.42.42.4: Starting osmo-stp 14:15:30.419056 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30495): Launched 14:15:30.731144 run osmo-stp_10.42.42.4(pid=30496): Launched 14:15:30.870542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:31.430309 run create_hlr_db(pid=30497): Launched 14:15:31.595231 bus /sierra_2: Setting Powered False 14:15:32.660130 run create_hlr_db(pid=30497): Terminated: ok {rc=0} 14:15:33.110511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30499): Launched 14:15:33.422086 run osmo-hlr_10.42.42.2(pid=30500): Launched 14:15:33.540828 run osmo-msc_10.42.42.5: Starting osmo-msc 14:15:34.119566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30502): Launched 14:15:34.431545 run osmo-msc_10.42.42.5(pid=30503): Launched 14:15:34.604256 run osmo-hlr_10.42.42.2(pid=30500): ERR: Terminated: ERROR {rc=237} [trial-2390↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30500)] 14:15:34.741512 run osmo-hlr_10.42.42.2(pid=30500): stdout: | (launched: 2022-12-13_14:15:33.364189) 14:15:34.873520 run osmo-hlr_10.42.42.2(pid=30500): stderr: | 20221213141533541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141533541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141533554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141533562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141533562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141533562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:35.003079 run osmo-hlr_10.42.42.2(pid=30500): stdout: | (launched: 2022-12-13_14:15:33.364189) 14:15:35.126467 run osmo-hlr_10.42.42.2(pid=30500): stderr: | 20221213141533541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141533541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141533541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141533554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141533562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141533562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141533562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:35.274429 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=30500): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30500) [trial-2390↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30500)] [trial-2390↪smpp↪esme_connect_policy_acceptall.py:23] 14:15:35.282853 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 14:15:35.309221 run osmo-msc_10.42.42.5(pid=30503): ERR: Terminated: ERROR {rc=9} [trial-2390↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=30503)] 14:15:35.358276 run osmo-msc_10.42.42.5(pid=30503): stdout: | (launched: 2022-12-13_14:15:34.372913) 14:15:35.408561 run osmo-msc_10.42.42.5(pid=30503): stderr: | 20221213141534692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213141534692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213141534692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141534692 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213141534692 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213141534692 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213141534692 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213141534693 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213141534693 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:15:35.458578 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30495): Terminating (SIGTERM) 14:15:35.498466 run osmo-stp_10.42.42.4(pid=30496): Terminating (SIGTERM) 14:15:35.538289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30499): Terminating (SIGTERM) 14:15:35.579549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30502): Terminating (SIGTERM) 14:15:35.620588 --- ParallelTerminationStrategy: PID 30495 died... 14:15:35.639958 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30495): Terminated: ok {rc=0} 14:15:35.684932 --- ParallelTerminationStrategy: PID 30496 died... 14:15:35.704052 run osmo-stp_10.42.42.4(pid=30496): Terminated: ok {rc=0} 14:15:35.748468 --- ParallelTerminationStrategy: PID 30499 died... 14:15:35.767267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30499): Terminated: ok {rc=0} 14:15:35.811966 --- ParallelTerminationStrategy: PID 30502 died... 14:15:35.831108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30502): Terminated: ok {rc=0} ---------------------------------------------- trial-2390 smpp esme_connect_policy_closed.py ---------------------------------------------- 14:15:35.880424 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:35.891576 tst smpp: Using 1 x bts (candidates: 1) 14:15:35.926750 tst esme_connect_policy_closed.py: using LAC 34507 14:15:36.056223 tst esme_connect_policy_closed.py: using RAC 82 14:15:36.189495 tst esme_connect_policy_closed.py: using CellId 34507 14:15:36.319206 tst esme_connect_policy_closed.py: using BVCI 34508 14:15:36.442438 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:36.453669 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:36.464684 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:36.489200 tst esme_connect_policy_closed.py: using MSISDN 8199 14:15:36.621714 tst esme_connect_policy_closed.py: using MSISDN 8200 14:15:36.744807 run osmo-stp_10.42.42.4: Starting osmo-stp 14:15:37.315844 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30506): Launched 14:15:37.651839 run osmo-stp_10.42.42.4(pid=30507): Launched 14:15:37.780895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:38.298813 run create_hlr_db(pid=30508): Launched 14:15:39.486195 run create_hlr_db(pid=30508): Terminated: ok {rc=0} 14:15:39.840133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30510): Launched 14:15:40.176259 run osmo-hlr_10.42.42.2(pid=30511): Launched 14:15:40.305314 run osmo-msc_10.42.42.5: Starting osmo-msc 14:15:40.918140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30513): Launched 14:15:41.254356 run osmo-msc_10.42.42.5(pid=30514): Launched 14:15:41.442980 run osmo-hlr_10.42.42.2(pid=30511): ERR: Terminated: ERROR {rc=237} [trial-2390↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30511)] 14:15:41.585034 run osmo-hlr_10.42.42.2(pid=30511): stdout: | (launched: 2022-12-13_14:15:40.114334) 14:15:41.727644 run osmo-hlr_10.42.42.2(pid=30511): stderr: | 20221213141540310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141540310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141540330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141540338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141540338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141540338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:41.868508 run osmo-hlr_10.42.42.2(pid=30511): stdout: | (launched: 2022-12-13_14:15:40.114334) 14:15:42.001534 run osmo-hlr_10.42.42.2(pid=30511): stderr: | 20221213141540310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141540310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141540310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141540330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141540338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141540338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141540338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:42.160712 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=30511): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30511) [trial-2390↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30511)] [trial-2390↪smpp↪esme_connect_policy_closed.py:31] 14:15:42.169838 tst esme_connect_policy_closed.py:31: Test FAILED (6.3 sec) 14:15:42.197422 run osmo-msc_10.42.42.5(pid=30514): ERR: Terminated: ERROR {rc=9} [trial-2390↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=30514)] 14:15:42.249593 run osmo-msc_10.42.42.5(pid=30514): stdout: | (launched: 2022-12-13_14:15:41.191904) 14:15:42.302904 run osmo-msc_10.42.42.5(pid=30514): stderr: | 20221213141541558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213141541558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213141541558 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141541558 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213141541558 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213141541558 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213141541558 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213141541558 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213141541559 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:15:42.356438 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30506): Terminating (SIGTERM) 14:15:42.398956 run osmo-stp_10.42.42.4(pid=30507): Terminating (SIGTERM) 14:15:42.441985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30510): Terminating (SIGTERM) 14:15:42.486799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30513): Terminating (SIGTERM) 14:15:42.533320 --- ParallelTerminationStrategy: PID 30506 died... 14:15:42.554995 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30506): Terminated: ok {rc=0} 14:15:42.604733 --- ParallelTerminationStrategy: PID 30507 died... 14:15:42.624629 run osmo-stp_10.42.42.4(pid=30507): Terminated: ok {rc=0} 14:15:42.671669 --- ParallelTerminationStrategy: PID 30510 died... 14:15:42.691405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30510): Terminated: ok {rc=0} 14:15:42.737619 --- ParallelTerminationStrategy: PID 30513 died... 14:15:42.757488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30513): Terminated: ok {rc=0} ---------------------------------------------- trial-2390 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 14:15:42.808838 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:42.820448 tst smpp: Using 1 x bts (candidates: 1) 14:15:42.856099 tst esme_ms_sms_storeforward.py: using LAC 34508 14:15:42.990033 tst esme_ms_sms_storeforward.py: using RAC 83 14:15:43.121603 tst esme_ms_sms_storeforward.py: using CellId 34508 14:15:43.252653 tst esme_ms_sms_storeforward.py: using BVCI 34509 14:15:43.374589 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:43.385813 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:43.396770 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:43.408102 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:43.419549 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:43.430872 tst smpp: Using 1 x modem (candidates: 1) 14:15:43.558713 tst esme_ms_sms_storeforward.py: using MSISDN 8201 14:15:43.673652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:44.157993 run create_hlr_db(pid=30517): Launched 14:15:45.341584 run create_hlr_db(pid=30517): Terminated: ok {rc=0} 14:15:45.673525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30519): Launched 14:15:46.013725 run osmo-hlr_10.42.42.2(pid=30520): Launched 14:15:46.297258 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:46.941675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30522): Launched 14:15:47.293710 run osmo-stp_10.42.42.5(pid=30523): Launched 14:15:47.424176 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:48.032049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30525): Launched 14:15:48.366698 run osmo-msc_10.42.42.6(pid=30526): Launched 14:15:48.553321 run osmo-stp_10.42.42.5(pid=30523): ERR: Terminated: ERROR {rc=1} [trial-2390↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30523)] 14:15:48.693364 run osmo-stp_10.42.42.5(pid=30523): stdout: | (launched: 2022-12-13_14:15:47.231523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:48.833913 run osmo-stp_10.42.42.5(pid=30523): stderr: | 20221213141547424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141547424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141547424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141547425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141547425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141547425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141547425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:48.972935 run osmo-stp_10.42.42.5(pid=30523): stdout: | (launched: 2022-12-13_14:15:47.231523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:49.105205 run osmo-stp_10.42.42.5(pid=30523): stderr: | 20221213141547424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141547424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141547424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141547425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141547425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141547425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141547425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:49.263425 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=30523): Process ended prematurely: osmo-stp_10.42.42.5(pid=30523) [trial-2390↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30523)] [trial-2390↪smpp↪esme_ms_sms_storeforward.py:30] 14:15:49.272440 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.5 sec) 14:15:49.300218 run osmo-hlr_10.42.42.2(pid=30520): ERR: Terminated: ERROR {rc=237} [trial-2390↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30520)] 14:15:49.351442 run osmo-hlr_10.42.42.2(pid=30520): stdout: | (launched: 2022-12-13_14:15:45.951500) 14:15:49.403688 run osmo-hlr_10.42.42.2(pid=30520): stderr: | 20221213141546200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141546200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141546200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141546200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141546200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141546200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141546215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141546226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141546226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141546226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:49.476510 run osmo-msc_10.42.42.6(pid=30526): ERR: Terminated: ERROR {rc=2} [trial-2390↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30526)] 14:15:49.526447 run osmo-msc_10.42.42.6(pid=30526): stdout: | (launched: 2022-12-13_14:15:48.304152) 14:15:49.578854 run osmo-msc_10.42.42.6(pid=30526): stderr: | 20221213141548628 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141548628 DLGLOBAL DEBUG validating counter group 0x7f9967055c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141548628 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141548628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141548629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141548629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141548631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141548631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141548631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141548631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:49.631502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30519): Terminating (SIGTERM) 14:15:49.673644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30522): Terminating (SIGTERM) 14:15:49.715989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30525): Terminating (SIGTERM) 14:15:49.759637 --- ParallelTerminationStrategy: PID 30519 died... 14:15:49.780453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30519): Terminated: ok {rc=0} 14:15:49.827038 --- ParallelTerminationStrategy: PID 30522 died... 14:15:49.846748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30522): Terminated: ok {rc=0} 14:15:49.893042 --- ParallelTerminationStrategy: PID 30525 died... 14:15:49.913268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30525): Terminated: ok {rc=0} 14:15:50.002494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:15:51.089500 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.101331 tst smpp: Using 1 x bts (candidates: 1) 14:15:51.139762 tst esme_ms_sms_transaction.py: using LAC 34509 14:15:51.272826 tst esme_ms_sms_transaction.py: using RAC 84 14:15:51.407933 tst esme_ms_sms_transaction.py: using CellId 34509 14:15:51.538839 tst esme_ms_sms_transaction.py: using BVCI 34510 14:15:51.661333 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.672250 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.683097 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.694074 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.705662 tst smpp: Using 1 x ip_address (candidates: 6) 14:15:51.716755 tst smpp: Using 1 x modem (candidates: 1) 14:15:51.845960 tst esme_ms_sms_transaction.py: using MSISDN 8202 14:15:51.969752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:52.490467 run create_hlr_db(pid=30529): Launched 14:15:52.619255 bus /sierra_2: Setting Powered False 14:15:53.684427 run create_hlr_db(pid=30529): Terminated: ok {rc=0} 14:15:54.131219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30531): Launched 14:15:54.445189 run osmo-hlr_10.42.42.2(pid=30532): Launched 14:15:54.565662 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:55.119124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30534): Launched 14:15:55.431313 run osmo-stp_10.42.42.5(pid=30535): Launched 14:15:55.552787 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:56.115810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30537): Launched 14:15:56.431137 run osmo-msc_10.42.42.6(pid=30538): Launched 14:15:56.607229 run osmo-stp_10.42.42.5(pid=30535): ERR: Terminated: ERROR {rc=1} [trial-2390↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30535)] 14:15:56.738478 run osmo-stp_10.42.42.5(pid=30535): stdout: | (launched: 2022-12-13_14:15:55.373133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:56.870673 run osmo-stp_10.42.42.5(pid=30535): stderr: | 20221213141555547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141555547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141555547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141555548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141555548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141555548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141555548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:57.000510 run osmo-stp_10.42.42.5(pid=30535): stdout: | (launched: 2022-12-13_14:15:55.373133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:57.124247 run osmo-stp_10.42.42.5(pid=30535): stderr: | 20221213141555547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141555547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141555547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141555548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141555548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141555548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141555548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:57.272052 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=30535): Process ended prematurely: osmo-stp_10.42.42.5(pid=30535) [trial-2390↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30535)] [trial-2390↪smpp↪esme_ms_sms_transaction.py:28] 14:15:57.280482 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 14:15:57.306333 run osmo-hlr_10.42.42.2(pid=30532): ERR: Terminated: ERROR {rc=237} [trial-2390↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30532)] 14:15:57.353548 run osmo-hlr_10.42.42.2(pid=30532): stdout: | (launched: 2022-12-13_14:15:54.386812) 14:15:57.402352 run osmo-hlr_10.42.42.2(pid=30532): stderr: | 20221213141554565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141554565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141554565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141554565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141554565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141554565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141554578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141554588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141554588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141554588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:57.470870 run osmo-msc_10.42.42.6(pid=30538): ERR: Terminated: ERROR {rc=2} [trial-2390↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30538)] 14:15:57.519652 run osmo-msc_10.42.42.6(pid=30538): stdout: | (launched: 2022-12-13_14:15:56.371814) 14:15:57.569087 run osmo-msc_10.42.42.6(pid=30538): stderr: | 20221213141556645 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141556645 DLGLOBAL DEBUG validating counter group 0x7f89f31e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141556645 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141556645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141556645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141556646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141556647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141556648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141556648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141556648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:57.618977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30531): Terminating (SIGTERM) 14:15:57.658488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30534): Terminating (SIGTERM) 14:15:57.698242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30537): Terminating (SIGTERM) 14:15:57.738803 --- ParallelTerminationStrategy: PID 30531 died... 14:15:57.757969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30531): Terminated: ok {rc=0} 14:15:57.802004 --- ParallelTerminationStrategy: PID 30534 died... 14:15:57.820436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30534): Terminated: ok {rc=0} 14:15:57.864385 --- ParallelTerminationStrategy: PID 30537 died... 14:15:57.883049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30537): Terminated: ok {rc=0} 14:15:57.969829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 encryption --------------------------------------------------------------------- 14:15:59.165800 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:59.169059 tst encryption: Verifying 1 x bts (candidates: 11) 14:15:59.190164 tst encryption: Verifying 6 x ip_address (candidates: 9) 14:15:59.217025 tst encryption: Verifying 1 x modem (candidates: 12) 14:15:59.252534 tst encryption: Reserving 1 x bts (candidates: 11) 14:15:59.273841 tst encryption: Reserving 6 x ip_address (candidates: 9) 14:15:59.300264 tst encryption: Reserving 1 x modem (candidates: 12) 14:15:59.828776 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2390 encryption register_a5_0_authopt.py ---------------------------------------------- 14:15:59.882416 tst encryption: Using 1 x ip_address (candidates: 6) 14:15:59.893209 tst encryption: Using 1 x bts (candidates: 1) 14:15:59.928190 tst register_a5_0_authopt.py: using LAC 34510 14:16:00.054424 tst register_a5_0_authopt.py: using RAC 85 14:16:00.179589 tst register_a5_0_authopt.py: using CellId 34510 14:16:00.314712 tst register_a5_0_authopt.py: using BVCI 34511 14:16:00.437980 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:00.449222 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:00.460323 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:00.471200 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:00.482596 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:00.494068 tst encryption: Using 1 x modem (candidates: 1) 14:16:00.611344 tst register_a5_0_authopt.py:8: start network... 14:16:00.823492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:01.328358 run create_hlr_db(pid=30543): Launched 14:16:01.513563 bus /sierra_2: Setting Powered False 14:16:02.576076 run create_hlr_db(pid=30543): Terminated: ok {rc=0} 14:16:03.036706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Launched 14:16:03.377408 run osmo-hlr_10.42.42.2(pid=30546): Launched 14:16:03.507824 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:04.091617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Launched 14:16:04.429104 run osmo-stp_10.42.42.5(pid=30549): Launched 14:16:04.560143 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:05.167221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30551): Launched 14:16:05.507039 run osmo-msc_10.42.42.6(pid=30552): Launched 14:16:05.697207 run osmo-stp_10.42.42.5(pid=30549): ERR: Terminated: ERROR {rc=1} [trial-2390↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30549)] 14:16:05.838932 run osmo-stp_10.42.42.5(pid=30549): stdout: | (launched: 2022-12-13_14:16:04.366641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:05.980850 run osmo-stp_10.42.42.5(pid=30549): stderr: | 20221213141604564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141604565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141604565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141604565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141604566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141604566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141604566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:06.120349 run osmo-stp_10.42.42.5(pid=30549): stdout: | (launched: 2022-12-13_14:16:04.366641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:06.253473 run osmo-stp_10.42.42.5(pid=30549): stderr: | 20221213141604564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141604565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141604565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141604565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141604566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141604566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141604566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:06.413611 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30549): Process ended prematurely: osmo-stp_10.42.42.5(pid=30549) [trial-2390↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30549)] [trial-2390↪encryption↪register_a5_0_authopt.py:8] 14:16:06.423345 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 14:16:06.451107 run osmo-hlr_10.42.42.2(pid=30546): ERR: Terminated: ERROR {rc=237} [trial-2390↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30546)] 14:16:06.501963 run osmo-hlr_10.42.42.2(pid=30546): stdout: | (launched: 2022-12-13_14:16:03.314318) 14:16:06.553948 run osmo-hlr_10.42.42.2(pid=30546): stderr: | 20221213141603517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141603517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141603517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141603517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141603517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141603517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141603529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141603538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141603538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141603538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:06.626422 run osmo-msc_10.42.42.6(pid=30552): ERR: Terminated: ERROR {rc=2} [trial-2390↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30552)] 14:16:06.676167 run osmo-msc_10.42.42.6(pid=30552): stdout: | (launched: 2022-12-13_14:16:05.444483) 14:16:06.728071 run osmo-msc_10.42.42.6(pid=30552): stderr: | 20221213141605770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141605771 DLGLOBAL DEBUG validating counter group 0x7fdfa5816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141605771 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141605771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141605771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141605771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141605773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141605773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141605773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141605774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:06.779954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Terminating (SIGTERM) 14:16:06.821706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Terminating (SIGTERM) 14:16:06.864162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30551): Terminating (SIGTERM) 14:16:06.906985 --- ParallelTerminationStrategy: PID 30545 died... 14:16:06.927545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30545): Terminated: ok {rc=0} 14:16:06.974576 --- ParallelTerminationStrategy: PID 30548 died... 14:16:06.994518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30548): Terminated: ok {rc=0} 14:16:07.041190 --- ParallelTerminationStrategy: PID 30551 died... 14:16:07.061163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30551): Terminated: ok {rc=0} 14:16:07.150324 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 encryption register_a5_0_authreq.py ---------------------------------------------- 14:16:08.305372 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.317507 tst encryption: Using 1 x bts (candidates: 1) 14:16:08.354864 tst register_a5_0_authreq.py: using LAC 34511 14:16:08.480045 tst register_a5_0_authreq.py: using RAC 86 14:16:08.613369 tst register_a5_0_authreq.py: using CellId 34511 14:16:08.745358 tst register_a5_0_authreq.py: using BVCI 34512 14:16:08.867671 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.878919 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.890212 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.901362 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.912678 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:08.924058 tst encryption: Using 1 x modem (candidates: 1) 14:16:09.044688 tst register_a5_0_authreq.py:8: start network... 14:16:09.256747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:09.745094 run create_hlr_db(pid=30554): Launched 14:16:09.875377 bus /sierra_2: Setting Powered False 14:16:10.936796 run create_hlr_db(pid=30554): Terminated: ok {rc=0} 14:16:11.397857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30556): Launched 14:16:11.738636 run osmo-hlr_10.42.42.2(pid=30557): Launched 14:16:11.869199 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:12.454015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30559): Launched 14:16:12.794447 run osmo-stp_10.42.42.5(pid=30560): Launched 14:16:12.925159 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:13.534058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30562): Launched 14:16:13.873980 run osmo-msc_10.42.42.6(pid=30563): Launched 14:16:14.062880 run osmo-stp_10.42.42.5(pid=30560): ERR: Terminated: ERROR {rc=1} [trial-2390↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30560)] 14:16:14.204296 run osmo-stp_10.42.42.5(pid=30560): stdout: | (launched: 2022-12-13_14:16:12.731550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:14.347127 run osmo-stp_10.42.42.5(pid=30560): stderr: | 20221213141612926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141612926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141612926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141612927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141612927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141612927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141612927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:14.487711 run osmo-stp_10.42.42.5(pid=30560): stdout: | (launched: 2022-12-13_14:16:12.731550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:14.621329 run osmo-stp_10.42.42.5(pid=30560): stderr: | 20221213141612926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141612926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141612926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141612927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141612927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141612927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141612927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:14.780675 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30560): Process ended prematurely: osmo-stp_10.42.42.5(pid=30560) [trial-2390↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30560)] [trial-2390↪encryption↪register_a5_0_authreq.py:8] 14:16:14.790715 tst register_a5_0_authreq.py:8: Test FAILED (6.5 sec) 14:16:14.818558 run osmo-hlr_10.42.42.2(pid=30557): ERR: Terminated: ERROR {rc=237} [trial-2390↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30557)] 14:16:14.869172 run osmo-hlr_10.42.42.2(pid=30557): stdout: | (launched: 2022-12-13_14:16:11.676119) 14:16:14.920778 run osmo-hlr_10.42.42.2(pid=30557): stderr: | 20221213141611877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141611877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141611877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141611877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141611877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141611877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141611890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141611901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141611901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141611901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:14.992678 run osmo-msc_10.42.42.6(pid=30563): ERR: Terminated: ERROR {rc=2} [trial-2390↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30563)] 14:16:15.042889 run osmo-msc_10.42.42.6(pid=30563): stdout: | (launched: 2022-12-13_14:16:13.811289) 14:16:15.095123 run osmo-msc_10.42.42.6(pid=30563): stderr: | 20221213141614137 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141614137 DLGLOBAL DEBUG validating counter group 0x7fcf0a173c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141614137 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141614137 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141614137 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141614138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141614139 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141614140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141614140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141614140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:15.147480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30556): Terminating (SIGTERM) 14:16:15.189285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30559): Terminating (SIGTERM) 14:16:15.231495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30562): Terminating (SIGTERM) 14:16:15.274377 --- ParallelTerminationStrategy: PID 30556 died... 14:16:15.295018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30556): Terminated: ok {rc=0} 14:16:15.342520 --- ParallelTerminationStrategy: PID 30559 died... 14:16:15.363372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30559): Terminated: ok {rc=0} 14:16:15.410116 --- ParallelTerminationStrategy: PID 30562 died... 14:16:15.430229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30562): Terminated: ok {rc=0} 14:16:15.519048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 encryption register_a5_1_authreq.py ---------------------------------------------- 14:16:16.671786 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:16.684533 tst encryption: Using 1 x bts (candidates: 1) 14:16:16.722730 tst register_a5_1_authreq.py: using LAC 34512 14:16:16.849191 tst register_a5_1_authreq.py: using RAC 87 14:16:17.020480 tst register_a5_1_authreq.py: using CellId 34512 14:16:17.147556 tst register_a5_1_authreq.py: using BVCI 34513 14:16:17.272748 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:17.284811 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:17.296920 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:17.308755 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:17.321790 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:17.333267 tst encryption: Using 1 x modem (candidates: 1) 14:16:17.452108 tst register_a5_1_authreq.py:8: start network... 14:16:17.665216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:18.157760 run create_hlr_db(pid=30565): Launched 14:16:18.288852 bus /sierra_2: Setting Powered False 14:16:19.351832 run create_hlr_db(pid=30565): Terminated: ok {rc=0} 14:16:19.813610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30567): Launched 14:16:20.155034 run osmo-hlr_10.42.42.2(pid=30568): Launched 14:16:20.284389 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:20.868761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30570): Launched 14:16:21.208310 run osmo-stp_10.42.42.5(pid=30571): Launched 14:16:21.339273 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:21.967982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30573): Launched 14:16:22.287590 run osmo-msc_10.42.42.6(pid=30574): Launched 14:16:22.463939 run osmo-stp_10.42.42.5(pid=30571): ERR: Terminated: ERROR {rc=1} [trial-2390↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30571)] 14:16:22.597109 run osmo-stp_10.42.42.5(pid=30571): stdout: | (launched: 2022-12-13_14:16:21.145649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:22.729142 run osmo-stp_10.42.42.5(pid=30571): stderr: | 20221213141621340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141621340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141621340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141621341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141621341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141621341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141621341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:22.859605 run osmo-stp_10.42.42.5(pid=30571): stdout: | (launched: 2022-12-13_14:16:21.145649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:22.984264 run osmo-stp_10.42.42.5(pid=30571): stderr: | 20221213141621340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141621340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141621340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141621341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141621341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141621341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141621341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:23.134113 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30571): Process ended prematurely: osmo-stp_10.42.42.5(pid=30571) [trial-2390↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30571)] [trial-2390↪encryption↪register_a5_1_authreq.py:8] 14:16:23.142987 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 14:16:23.169248 run osmo-hlr_10.42.42.2(pid=30568): ERR: Terminated: ERROR {rc=237} [trial-2390↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30568)] 14:16:23.216886 run osmo-hlr_10.42.42.2(pid=30568): stdout: | (launched: 2022-12-13_14:16:20.091978) 14:16:23.265998 run osmo-hlr_10.42.42.2(pid=30568): stderr: | 20221213141620296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141620297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141620297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141620297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141620297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141620297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141620308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141620317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141620318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141620318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:23.334532 run osmo-msc_10.42.42.6(pid=30574): ERR: Terminated: ERROR {rc=2} [trial-2390↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30574)] 14:16:23.382088 run osmo-msc_10.42.42.6(pid=30574): stdout: | (launched: 2022-12-13_14:16:22.228399) 14:16:23.431005 run osmo-msc_10.42.42.6(pid=30574): stderr: | 20221213141622504 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141622505 DLGLOBAL DEBUG validating counter group 0x7fd8c4684c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141622505 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141622505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141622505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141622505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141622507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141622507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141622507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141622507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:23.480558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30567): Terminating (SIGTERM) 14:16:23.520097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30570): Terminating (SIGTERM) 14:16:23.560134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30573): Terminating (SIGTERM) 14:16:23.600362 --- ParallelTerminationStrategy: PID 30567 died... 14:16:23.619587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30567): Terminated: ok {rc=0} 14:16:23.663842 --- ParallelTerminationStrategy: PID 30570 died... 14:16:23.682548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30570): Terminated: ok {rc=0} 14:16:23.726749 --- ParallelTerminationStrategy: PID 30573 died... 14:16:23.745685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30573): Terminated: ok {rc=0} 14:16:23.832367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2390 encryption register_a5_3_authreq.py ---------------------------------------------- 14:16:24.985492 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:24.996687 tst encryption: Using 1 x bts (candidates: 1) 14:16:25.033340 tst register_a5_3_authreq.py: using LAC 34513 14:16:25.159254 tst register_a5_3_authreq.py: using RAC 88 14:16:25.284884 tst register_a5_3_authreq.py: using CellId 34513 14:16:25.410205 tst register_a5_3_authreq.py: using BVCI 34514 14:16:25.526090 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:25.536612 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:25.547179 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:25.557551 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:25.567914 tst encryption: Using 1 x ip_address (candidates: 6) 14:16:25.578543 tst encryption: Using 1 x modem (candidates: 1) 14:16:25.712930 tst register_a5_3_authreq.py:8: start network... 14:16:25.942010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:26.464211 run create_hlr_db(pid=30576): Launched 14:16:26.595312 bus /sierra_2: Setting Powered False 14:16:27.660818 run create_hlr_db(pid=30576): Terminated: ok {rc=0} 14:16:28.111945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30578): Launched 14:16:28.432423 run osmo-hlr_10.42.42.2(pid=30579): Launched 14:16:28.554218 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:29.114019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30581): Launched 14:16:29.432124 run osmo-stp_10.42.42.5(pid=30582): Launched 14:16:29.553377 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:30.124628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30584): Launched 14:16:30.444172 run osmo-msc_10.42.42.6(pid=30585): Launched 14:16:30.621469 run osmo-stp_10.42.42.5(pid=30582): ERR: Terminated: ERROR {rc=1} [trial-2390↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30582)] 14:16:30.754537 run osmo-stp_10.42.42.5(pid=30582): stdout: | (launched: 2022-12-13_14:16:29.373308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:30.900661 run osmo-stp_10.42.42.5(pid=30582): stderr: | 20221213141629547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141629547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141629547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141629547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141629548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141629548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141629548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:31.034471 run osmo-stp_10.42.42.5(pid=30582): stdout: | (launched: 2022-12-13_14:16:29.373308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:31.162290 run osmo-stp_10.42.42.5(pid=30582): stderr: | 20221213141629547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141629547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141629547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141629547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141629548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141629548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141629548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:31.315191 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30582): Process ended prematurely: osmo-stp_10.42.42.5(pid=30582) [trial-2390↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30582)] [trial-2390↪encryption↪register_a5_3_authreq.py:8] 14:16:31.325364 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 14:16:31.352547 run osmo-hlr_10.42.42.2(pid=30579): ERR: Terminated: ERROR {rc=237} [trial-2390↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30579)] 14:16:31.401135 run osmo-hlr_10.42.42.2(pid=30579): stdout: | (launched: 2022-12-13_14:16:28.373665) 14:16:31.451227 run osmo-hlr_10.42.42.2(pid=30579): stderr: | 20221213141628553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141628554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141628554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141628554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141628554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141628554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141628566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141628574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141628574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141628574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:31.521204 run osmo-msc_10.42.42.6(pid=30585): ERR: Terminated: ERROR {rc=2} [trial-2390↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30585)] 14:16:31.569882 run osmo-msc_10.42.42.6(pid=30585): stdout: | (launched: 2022-12-13_14:16:30.385253) 14:16:31.620349 run osmo-msc_10.42.42.6(pid=30585): stderr: | 20221213141630660 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141630660 DLGLOBAL DEBUG validating counter group 0x7f9b49dcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141630660 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141630660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141630660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141630660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141630662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141630663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141630663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141630663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:31.670469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30578): Terminating (SIGTERM) 14:16:31.710942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30581): Terminating (SIGTERM) 14:16:31.751612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30584): Terminating (SIGTERM) 14:16:31.793210 --- ParallelTerminationStrategy: PID 30578 died... 14:16:31.813030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30578): Terminated: ok {rc=0} 14:16:31.858873 --- ParallelTerminationStrategy: PID 30581 died... 14:16:31.878105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30581): Terminated: ok {rc=0} 14:16:31.922880 --- ParallelTerminationStrategy: PID 30584 died... 14:16:31.942201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30584): Terminated: ok {rc=0} 14:16:32.029068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 14:16:33.237595 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:33.242545 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 14:16:33.260751 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 14:16:33.287858 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 14:16:33.316419 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 14:16:33.336566 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 14:16:33.364786 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 14:16:33.873277 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 14:16:33.878340 tst handover.py:11: TEST_CONFIG: {} 14:16:34.106557 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:16:34.123387 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:16:34.147082 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:16:34.200538 tst handover.py: using MSISDN 8203 14:16:34.326908 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8203', subscriber_id=0} 14:16:34.446605 run srsepc_10.42.42.118: Starting srsepc 14:16:36.393686 run rm-remote-dir(pid=30590): Launched 14:16:36.528515 bus /sierra_2: Setting Powered False 14:16:37.599205 run rm-remote-dir(pid=30590): Terminated: ok {rc=0} 14:16:38.066974 run mk-remote-dir(pid=30591): Launched 14:16:39.254085 run mk-remote-dir(pid=30591): Terminated: ok {rc=0} 14:16:39.551846 run scp-inst-to-remote(pid=30592): Launched 14:16:41.740249 run scp-inst-to-remote(pid=30592): Terminated: ok {rc=0} 14:16:42.086380 run rm-remote-dir(pid=30594): Launched 14:16:43.273728 run rm-remote-dir(pid=30594): Terminated: ok {rc=0} 14:16:43.622130 run mk-remote-dir(pid=30595): Launched 14:16:44.808822 run mk-remote-dir(pid=30595): Terminated: ok {rc=0} 14:16:45.105990 run scp-cfg-to-remote(pid=30596): Launched 14:16:46.292317 run scp-cfg-to-remote(pid=30596): Terminated: ok {rc=0} 14:16:46.599245 run scp-db-to-remote(pid=30598): Launched 14:16:47.860663 run scp-db-to-remote(pid=30598): Terminated: ok {rc=0} 14:16:47.996368 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:16:48.316177 run patchelf(pid=30600): Launched 14:16:49.501100 run patchelf(pid=30600): Terminated: ok {rc=0} 14:16:49.637238 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:16:49.957149 run setcap-netadm(pid=30601): Launched 14:16:51.142903 run setcap-netadm(pid=30601): Terminated: ok {rc=0} 14:16:51.478600 run srsepc(pid=30602): Launched 14:16:51.599655 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:16:52.744711 run rm-remote-dir(pid=30603): Launched 14:16:52.929284 run srsepc(pid=30602): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30602)] 14:16:53.069137 run srsepc(pid=30602): stdout: | (launched: 2022-12-13_14:16:51.419011) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:16:53.207562 run srsepc(pid=30602): stderr: | (launched: 2022-12-13_14:16:51.466307) | Connection to 10.42.42.116 closed. 14:16:53.346432 run srsepc(pid=30602): stdout: | (launched: 2022-12-13_14:16:51.419011) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:16:53.479847 run srsepc(pid=30602): stderr: | (launched: 2022-12-13_14:16:51.466307) | Connection to 10.42.42.116 closed. 14:16:53.637996 run rm-remote-dir(pid=30603): Terminating (SIGINT) 14:16:53.821100 run rm-remote-dir(pid=30603): Terminated: ok {rc=0} 14:16:53.953200 tst handover.py:37: ERR: Error: srsepc(pid=30602): Process ended prematurely: srsepc(pid=30602) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30602)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 14:16:53.963746 tst handover.py:37: Test FAILED (20.1 sec) 14:16:54.043101 run scp-back-log(pid=30604): Launched 14:16:55.122714 run scp-back-log(pid=30604): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30604)] 14:16:55.183817 run scp-back-log(pid=30604): stdout: | (launched: 2022-12-13_14:16:54.010908) 14:16:55.246422 run scp-back-log(pid=30604): stderr: | (launched: 2022-12-13_14:16:54.030761) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:16:55.316989 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30604): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30604)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 14:16:55.362670 tst iperf3_bidir.py:13: Number of physical ue: 1 14:16:55.576940 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:16:55.619389 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 14:16:55.830659 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:16:55.846668 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:16:55.878393 tst iperf3_bidir.py: using MSISDN 8204 14:16:55.993353 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8204', subscriber_id=0} 14:16:56.104090 run srsepc_10.42.42.118: Starting srsepc 14:16:56.755115 run rm-remote-dir(pid=30606): Launched 14:16:57.942924 run rm-remote-dir(pid=30606): Terminated: ok {rc=0} 14:16:58.290565 run mk-remote-dir(pid=30607): Launched 14:16:59.477216 run mk-remote-dir(pid=30607): Terminated: ok {rc=0} 14:16:59.775136 run scp-inst-to-remote(pid=30608): Launched 14:17:01.977142 run scp-inst-to-remote(pid=30608): Terminated: ok {rc=0} 14:17:02.402606 run rm-remote-dir(pid=30613): Launched 14:17:03.649515 run rm-remote-dir(pid=30613): Terminated: ok {rc=0} 14:17:03.995812 run mk-remote-dir(pid=30614): Launched 14:17:05.183748 run mk-remote-dir(pid=30614): Terminated: ok {rc=0} 14:17:05.479469 run scp-cfg-to-remote(pid=30615): Launched 14:17:06.663041 run scp-cfg-to-remote(pid=30615): Terminated: ok {rc=0} 14:17:06.956567 run scp-db-to-remote(pid=30617): Launched 14:17:08.143050 run scp-db-to-remote(pid=30617): Terminated: ok {rc=0} 14:17:08.277816 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:17:08.596561 run patchelf(pid=30619): Launched 14:17:09.781074 run patchelf(pid=30619): Terminated: ok {rc=0} 14:17:09.916224 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:17:10.236566 run setcap-netadm(pid=30620): Launched 14:17:11.419414 run setcap-netadm(pid=30620): Terminated: ok {rc=0} 14:17:11.754014 run srsepc(pid=30621): Launched 14:17:11.875672 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:17:13.024704 run rm-remote-dir(pid=30622): Launched 14:17:13.207314 run srsepc(pid=30621): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30621)] 14:17:13.347050 run srsepc(pid=30621): stdout: | (launched: 2022-12-13_14:17:11.694077) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:13.485141 run srsepc(pid=30621): stderr: | (launched: 2022-12-13_14:17:11.741603) | Connection to 10.42.42.116 closed. 14:17:13.622957 run srsepc(pid=30621): stdout: | (launched: 2022-12-13_14:17:11.694077) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:13.755621 run srsepc(pid=30621): stderr: | (launched: 2022-12-13_14:17:11.741603) | Connection to 10.42.42.116 closed. 14:17:13.913133 run rm-remote-dir(pid=30622): Terminating (SIGINT) 14:17:14.094661 run rm-remote-dir(pid=30622): Terminated: ok {rc=0} 14:17:14.226113 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=30621): Process ended prematurely: srsepc(pid=30621) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30621)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 14:17:14.236355 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 14:17:14.315157 run scp-back-log(pid=30623): Launched 14:17:15.394297 run scp-back-log(pid=30623): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30623)] 14:17:15.455117 run scp-back-log(pid=30623): stdout: | (launched: 2022-12-13_14:17:14.282935) 14:17:15.517119 run scp-back-log(pid=30623): stderr: | (launched: 2022-12-13_14:17:14.302851) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:17:15.586887 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30623): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30623)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 14:17:15.632348 tst iperf3_dl.py:13: Number of physical ue: 1 14:17:15.850476 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:17:15.915255 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 14:17:16.147338 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:17:16.165159 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:17:16.199991 tst iperf3_dl.py: using MSISDN 8205 14:17:16.330401 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8205', subscriber_id=0} 14:17:16.455247 run srsepc_10.42.42.118: Starting srsepc 14:17:17.168582 run rm-remote-dir(pid=30625): Launched 14:17:18.366782 run rm-remote-dir(pid=30625): Terminated: ok {rc=0} 14:17:18.735414 run mk-remote-dir(pid=30626): Launched 14:17:19.931261 run mk-remote-dir(pid=30626): Terminated: ok {rc=0} 14:17:20.246675 run scp-inst-to-remote(pid=30627): Launched 14:17:22.442577 run scp-inst-to-remote(pid=30627): Terminated: ok {rc=0} 14:17:22.810090 run rm-remote-dir(pid=30629): Launched 14:17:24.006824 run rm-remote-dir(pid=30629): Terminated: ok {rc=0} 14:17:24.375961 run mk-remote-dir(pid=30630): Launched 14:17:25.572202 run mk-remote-dir(pid=30630): Terminated: ok {rc=0} 14:17:25.887113 run scp-cfg-to-remote(pid=30631): Launched 14:17:27.082319 run scp-cfg-to-remote(pid=30631): Terminated: ok {rc=0} 14:17:27.396743 run scp-db-to-remote(pid=30633): Launched 14:17:28.592580 run scp-db-to-remote(pid=30633): Terminated: ok {rc=0} 14:17:28.737212 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:17:29.077521 run patchelf(pid=30635): Launched 14:17:30.272156 run patchelf(pid=30635): Terminated: ok {rc=0} 14:17:30.417867 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:17:30.758322 run setcap-netadm(pid=30636): Launched 14:17:31.967701 run setcap-netadm(pid=30636): Terminated: ok {rc=0} 14:17:32.350923 run srsepc(pid=30637): Launched 14:17:32.473665 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:17:33.627322 run rm-remote-dir(pid=30638): Launched 14:17:33.812397 run srsepc(pid=30637): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30637)] 14:17:33.951559 run srsepc(pid=30637): stdout: | (launched: 2022-12-13_14:17:32.290672) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:34.090433 run srsepc(pid=30637): stderr: | (launched: 2022-12-13_14:17:32.338310) | Connection to 10.42.42.116 closed. 14:17:34.228479 run srsepc(pid=30637): stdout: | (launched: 2022-12-13_14:17:32.290672) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:34.362228 run srsepc(pid=30637): stderr: | (launched: 2022-12-13_14:17:32.338310) | Connection to 10.42.42.116 closed. 14:17:34.519787 run rm-remote-dir(pid=30638): Terminating (SIGINT) 14:17:34.702274 run rm-remote-dir(pid=30638): Terminated: ok {rc=0} 14:17:34.834149 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=30637): Process ended prematurely: srsepc(pid=30637) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30637)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 14:17:34.844362 tst iperf3_dl.py:42: Test FAILED (19.2 sec) 14:17:34.923696 run scp-back-log(pid=30639): Launched 14:17:36.003292 run scp-back-log(pid=30639): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30639)] 14:17:36.064255 run scp-back-log(pid=30639): stdout: | (launched: 2022-12-13_14:17:34.891449) 14:17:36.126926 run scp-back-log(pid=30639): stderr: | (launched: 2022-12-13_14:17:34.911271) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:17:36.197433 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30639): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30639)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 14:17:36.243082 tst iperf3_ul.py:13: Number of physical ue: 1 14:17:36.462933 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:17:36.505402 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 14:17:36.712383 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:17:36.728169 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:17:36.760310 tst iperf3_ul.py: using MSISDN 8206 14:17:36.883478 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8206', subscriber_id=0} 14:17:37.001213 run srsepc_10.42.42.118: Starting srsepc 14:17:37.683834 run rm-remote-dir(pid=30641): Launched 14:17:38.876742 run rm-remote-dir(pid=30641): Terminated: ok {rc=0} 14:17:39.239213 run mk-remote-dir(pid=30642): Launched 14:17:40.434820 run mk-remote-dir(pid=30642): Terminated: ok {rc=0} 14:17:40.744321 run scp-inst-to-remote(pid=30643): Launched 14:17:42.938157 run scp-inst-to-remote(pid=30643): Terminated: ok {rc=0} 14:17:43.299775 run rm-remote-dir(pid=30645): Launched 14:17:44.493809 run rm-remote-dir(pid=30645): Terminated: ok {rc=0} 14:17:44.856445 run mk-remote-dir(pid=30646): Launched 14:17:46.047391 run mk-remote-dir(pid=30646): Terminated: ok {rc=0} 14:17:46.367516 run scp-cfg-to-remote(pid=30647): Launched 14:17:47.633580 run scp-cfg-to-remote(pid=30647): Terminated: ok {rc=0} 14:17:47.938403 run scp-db-to-remote(pid=30649): Launched 14:17:49.126359 run scp-db-to-remote(pid=30649): Terminated: ok {rc=0} 14:17:49.266322 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:17:49.596891 run patchelf(pid=30651): Launched 14:17:50.784163 run patchelf(pid=30651): Terminated: ok {rc=0} 14:17:50.924807 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:17:51.255021 run setcap-netadm(pid=30652): Launched 14:17:52.443572 run setcap-netadm(pid=30652): Terminated: ok {rc=0} 14:17:52.790001 run srsepc(pid=30653): Launched 14:17:52.911256 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:17:54.091364 run rm-remote-dir(pid=30654): Launched 14:17:54.277552 run srsepc(pid=30653): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30653)] 14:17:54.420568 run srsepc(pid=30653): stdout: | (launched: 2022-12-13_14:17:52.729502) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:54.564330 run srsepc(pid=30653): stderr: | (launched: 2022-12-13_14:17:52.778131) | Connection to 10.42.42.116 closed. 14:17:54.707323 run srsepc(pid=30653): stdout: | (launched: 2022-12-13_14:17:52.729502) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:17:54.845142 run srsepc(pid=30653): stderr: | (launched: 2022-12-13_14:17:52.778131) | Connection to 10.42.42.116 closed. 14:17:55.008503 run rm-remote-dir(pid=30654): Terminating (SIGINT) 14:17:55.196749 run rm-remote-dir(pid=30654): Terminated: ok {rc=0} 14:17:55.333321 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=30653): Process ended prematurely: srsepc(pid=30653) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30653)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 14:17:55.343976 tst iperf3_ul.py:42: Test FAILED (19.1 sec) 14:17:55.425637 run scp-back-log(pid=30655): Launched 14:17:56.504323 run scp-back-log(pid=30655): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30655)] 14:17:56.567798 run scp-back-log(pid=30655): stdout: | (launched: 2022-12-13_14:17:55.393053) 14:17:56.632361 run scp-back-log(pid=30655): stderr: | (launched: 2022-12-13_14:17:55.413644) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:17:56.705162 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30655): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30655)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 14:17:56.752487 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:17:56.769874 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:17:56.793847 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:17:56.848894 tst ping.py: using MSISDN 8207 14:17:56.970571 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8207', subscriber_id=0} 14:17:57.085283 run srsepc_10.42.42.118: Starting srsepc 14:17:57.755880 run rm-remote-dir(pid=30657): Launched 14:17:58.945534 run rm-remote-dir(pid=30657): Terminated: ok {rc=0} 14:17:59.302067 run mk-remote-dir(pid=30658): Launched 14:18:00.491420 run mk-remote-dir(pid=30658): Terminated: ok {rc=0} 14:18:00.795863 run scp-inst-to-remote(pid=30659): Launched 14:18:02.988474 run scp-inst-to-remote(pid=30659): Terminated: ok {rc=0} 14:18:03.343510 run rm-remote-dir(pid=30661): Launched 14:18:04.533681 run rm-remote-dir(pid=30661): Terminated: ok {rc=0} 14:18:04.890917 run mk-remote-dir(pid=30662): Launched 14:18:06.081025 run mk-remote-dir(pid=30662): Terminated: ok {rc=0} 14:18:06.385732 run scp-cfg-to-remote(pid=30663): Launched 14:18:07.564653 run scp-cfg-to-remote(pid=30663): Terminated: ok {rc=0} 14:18:07.847741 run scp-db-to-remote(pid=30665): Launched 14:18:09.025627 run scp-db-to-remote(pid=30665): Terminated: ok {rc=0} 14:18:09.156534 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:18:09.463405 run patchelf(pid=30667): Launched 14:18:10.639361 run patchelf(pid=30667): Terminated: ok {rc=0} 14:18:10.770479 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:18:11.077304 run setcap-netadm(pid=30668): Launched 14:18:12.253409 run setcap-netadm(pid=30668): Terminated: ok {rc=0} 14:18:12.575855 run srsepc(pid=30669): Launched 14:18:12.690874 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:18:13.799381 run rm-remote-dir(pid=30670): Launched 14:18:13.976051 run srsepc(pid=30669): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30669)] 14:18:14.110958 run srsepc(pid=30669): stdout: | (launched: 2022-12-13_14:18:12.519236) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:14.244890 run srsepc(pid=30669): stderr: | (launched: 2022-12-13_14:18:12.564360) | Connection to 10.42.42.116 closed. 14:18:14.378817 run srsepc(pid=30669): stdout: | (launched: 2022-12-13_14:18:12.519236) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:14.507782 run srsepc(pid=30669): stderr: | (launched: 2022-12-13_14:18:12.564360) | Connection to 10.42.42.116 closed. 14:18:14.660580 run rm-remote-dir(pid=30670): Terminating (SIGINT) 14:18:14.837299 run rm-remote-dir(pid=30670): Terminated: ok {rc=0} 14:18:14.965684 tst ping.py:16: ERR: Error: srsepc(pid=30669): Process ended prematurely: srsepc(pid=30669) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30669)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 14:18:14.975607 tst ping.py:16: Test FAILED (18.2 sec) 14:18:15.052528 run scp-back-log(pid=30671): Launched 14:18:16.130222 run scp-back-log(pid=30671): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30671)] 14:18:16.204904 run scp-back-log(pid=30671): stdout: | (launched: 2022-12-13_14:18:15.021318) 14:18:16.282426 run scp-back-log(pid=30671): stderr: | (launched: 2022-12-13_14:18:15.040785) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:18:16.359726 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30671): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30671)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 14:18:16.410524 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:18:16.428517 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:18:16.455324 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:18:16.507857 tst rrc_idle_mo_ping.py: using MSISDN 8208 14:18:16.622528 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8208', subscriber_id=0} 14:18:16.731733 run srsepc_10.42.42.118: Starting srsepc 14:18:17.370022 run rm-remote-dir(pid=30673): Launched 14:18:18.551850 run rm-remote-dir(pid=30673): Terminated: ok {rc=0} 14:18:18.890129 run mk-remote-dir(pid=30674): Launched 14:18:20.069724 run mk-remote-dir(pid=30674): Terminated: ok {rc=0} 14:18:20.358323 run scp-inst-to-remote(pid=30675): Launched 14:18:22.538256 run scp-inst-to-remote(pid=30675): Terminated: ok {rc=0} 14:18:22.874411 run rm-remote-dir(pid=30677): Launched 14:18:24.054979 run rm-remote-dir(pid=30677): Terminated: ok {rc=0} 14:18:24.391508 run mk-remote-dir(pid=30678): Launched 14:18:25.571935 run mk-remote-dir(pid=30678): Terminated: ok {rc=0} 14:18:25.859867 run scp-cfg-to-remote(pid=30679): Launched 14:18:27.039100 run scp-cfg-to-remote(pid=30679): Terminated: ok {rc=0} 14:18:27.324644 run scp-db-to-remote(pid=30681): Launched 14:18:28.503719 run scp-db-to-remote(pid=30681): Terminated: ok {rc=0} 14:18:28.635369 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:18:28.945853 run patchelf(pid=30683): Launched 14:18:30.123544 run patchelf(pid=30683): Terminated: ok {rc=0} 14:18:30.256057 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:18:30.566611 run setcap-netadm(pid=30684): Launched 14:18:31.754785 run setcap-netadm(pid=30684): Terminated: ok {rc=0} 14:18:32.171471 run srsepc(pid=30685): Launched 14:18:32.360346 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:18:33.479373 run rm-remote-dir(pid=30686): Launched 14:18:33.657855 run srsepc(pid=30685): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30685)] 14:18:33.793648 run srsepc(pid=30685): stdout: | (launched: 2022-12-13_14:18:32.104813) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:33.928283 run srsepc(pid=30685): stderr: | (launched: 2022-12-13_14:18:32.157583) | Connection to 10.42.42.116 closed. 14:18:34.063179 run srsepc(pid=30685): stdout: | (launched: 2022-12-13_14:18:32.104813) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:34.192428 run srsepc(pid=30685): stderr: | (launched: 2022-12-13_14:18:32.157583) | Connection to 10.42.42.116 closed. 14:18:34.346071 run rm-remote-dir(pid=30686): Terminating (SIGINT) 14:18:34.524264 run rm-remote-dir(pid=30686): Terminated: ok {rc=0} 14:18:34.653608 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=30685): Process ended prematurely: srsepc(pid=30685) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30685)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 14:18:34.663613 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 14:18:34.740424 run scp-back-log(pid=30687): Launched 14:18:35.816519 run scp-back-log(pid=30687): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30687)] 14:18:35.877259 run scp-back-log(pid=30687): stdout: | (launched: 2022-12-13_14:18:34.709648) 14:18:35.938241 run scp-back-log(pid=30687): stderr: | (launched: 2022-12-13_14:18:34.728942) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:18:36.007098 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30687): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30687)]') ---------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 14:18:36.052275 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:18:36.068899 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:18:36.092286 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:18:36.142309 tst rrc_idle_mt_ping.py: using MSISDN 8209 14:18:36.264146 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8209', subscriber_id=0} 14:18:36.379797 run srsepc_10.42.42.118: Starting srsepc 14:18:37.056007 run rm-remote-dir(pid=30689): Launched 14:18:38.248740 run rm-remote-dir(pid=30689): Terminated: ok {rc=0} 14:18:38.610267 run mk-remote-dir(pid=30690): Launched 14:18:39.801441 run mk-remote-dir(pid=30690): Terminated: ok {rc=0} 14:18:40.110651 run scp-inst-to-remote(pid=30691): Launched 14:18:42.298787 run scp-inst-to-remote(pid=30691): Terminated: ok {rc=0} 14:18:42.636357 run rm-remote-dir(pid=30693): Launched 14:18:43.818702 run rm-remote-dir(pid=30693): Terminated: ok {rc=0} 14:18:44.157960 run mk-remote-dir(pid=30694): Launched 14:18:45.340027 run mk-remote-dir(pid=30694): Terminated: ok {rc=0} 14:18:45.629973 run scp-cfg-to-remote(pid=30695): Launched 14:18:46.812178 run scp-cfg-to-remote(pid=30695): Terminated: ok {rc=0} 14:18:47.130388 run scp-db-to-remote(pid=30697): Launched 14:18:48.362456 run scp-db-to-remote(pid=30697): Terminated: ok {rc=0} 14:18:48.503970 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:18:48.837132 run patchelf(pid=30699): Launched 14:18:50.027512 run patchelf(pid=30699): Terminated: ok {rc=0} 14:18:50.169702 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:18:50.503118 run setcap-netadm(pid=30700): Launched 14:18:51.692586 run setcap-netadm(pid=30700): Terminated: ok {rc=0} 14:18:52.041471 run srsepc(pid=30701): Launched 14:18:52.165135 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:18:53.358048 run rm-remote-dir(pid=30702): Launched 14:18:53.546006 run srsepc(pid=30701): ERR: Terminated: ERROR {rc=127} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30701)] 14:18:53.689012 run srsepc(pid=30701): stdout: | (launched: 2022-12-13_14:18:51.980409) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:53.832485 run srsepc(pid=30701): stderr: | (launched: 2022-12-13_14:18:52.029755) | Connection to 10.42.42.116 closed. 14:18:53.976242 run srsepc(pid=30701): stdout: | (launched: 2022-12-13_14:18:51.980409) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:18:54.115005 run srsepc(pid=30701): stderr: | (launched: 2022-12-13_14:18:52.029755) | Connection to 10.42.42.116 closed. 14:18:54.278978 run rm-remote-dir(pid=30702): Terminating (SIGINT) 14:18:54.469434 run rm-remote-dir(pid=30702): Terminated: ok {rc=0} 14:18:54.606787 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=30701): Process ended prematurely: srsepc(pid=30701) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30701)] [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 14:18:54.617317 tst rrc_idle_mt_ping.py:16: Test FAILED (18.6 sec) 14:18:54.698634 run scp-back-log(pid=30703): Launched 14:18:55.777909 run scp-back-log(pid=30703): ERR: Terminated: ERROR {rc=1} [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30703)] 14:18:55.841589 run scp-back-log(pid=30703): stdout: | (launched: 2022-12-13_14:18:54.666182) 14:18:55.907036 run scp-back-log(pid=30703): stderr: | (launched: 2022-12-13_14:18:54.686771) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:18:55.979988 tst srsepc_10.42.42.118: Error('scp-back-log(pid=30703): launch_sync(): local process exited with status 1 [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=30703)]') --------------------------------------------------------------------- trial-2390 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 14:18:56.112774 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:18:56.118010 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 14:18:56.159229 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 14:18:56.185742 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 14:18:56.236804 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 14:18:56.278860 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 14:18:56.304859 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 14:18:56.858696 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 14:18:56.864285 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:56.875589 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:18:56.916358 tst handover.py: using LAC 34514 14:18:57.049333 tst handover.py: using RAC 89 14:18:57.182000 tst handover.py: using CellId 34514 14:18:57.324404 tst handover.py: using BVCI 34515 14:18:57.446121 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:18:57.481592 tst handover.py: using LAC 34515 14:18:57.609946 tst handover.py: using RAC 90 14:18:57.740580 tst handover.py: using CellId 34515 14:18:57.869943 tst handover.py: using BVCI 34516 14:18:57.981397 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:57.992144 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:58.002901 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:58.013608 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:58.024284 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:18:58.035028 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:18:58.150557 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:18:58.272713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:18:58.779060 run create_hlr_db(pid=30708): Launched 14:18:59.971428 run create_hlr_db(pid=30708): Terminated: ok {rc=0} 14:19:00.315667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30710): Launched 14:19:00.642048 run osmo-hlr_10.42.42.2(pid=30711): Launched 14:19:00.766104 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:01.413702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30713): Launched 14:19:01.761052 run osmo-stp_10.42.42.5(pid=30714): Launched 14:19:02.008312 run osmo-msc_10.42.42.6: Starting osmo-msc 14:19:02.680721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30716): Launched 14:19:03.012248 run osmo-msc_10.42.42.6(pid=30717): Launched 14:19:03.198305 run osmo-stp_10.42.42.5(pid=30714): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30714)] 14:19:03.336564 run osmo-stp_10.42.42.5(pid=30714): stdout: | (launched: 2022-12-13_14:19:01.696665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:03.476281 run osmo-stp_10.42.42.5(pid=30714): stderr: | 20221213141901988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141901988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141901988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141901989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141901989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141901989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141901989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:03.614847 run osmo-stp_10.42.42.5(pid=30714): stdout: | (launched: 2022-12-13_14:19:01.696665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:03.746255 run osmo-stp_10.42.42.5(pid=30714): stderr: | 20221213141901988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141901988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141901988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141901989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141901989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141901989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141901989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:03.902954 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30714): Process ended prematurely: osmo-stp_10.42.42.5(pid=30714) [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30714)] [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 14:19:03.911852 tst handover.py:18: Test FAILED (7.0 sec) 14:19:03.939231 run osmo-hlr_10.42.42.2(pid=30711): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30711)] 14:19:03.990080 run osmo-hlr_10.42.42.2(pid=30711): stdout: | (launched: 2022-12-13_14:19:00.582123) 14:19:04.042158 run osmo-hlr_10.42.42.2(pid=30711): stderr: | 20221213141900777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141900777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141900777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141900777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141900777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141900777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141900790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141900798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141900799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141900799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:19:04.114576 run osmo-msc_10.42.42.6(pid=30717): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30717)] 14:19:04.164235 run osmo-msc_10.42.42.6(pid=30717): stdout: | (launched: 2022-12-13_14:19:02.950802) 14:19:04.216101 run osmo-msc_10.42.42.6(pid=30717): stderr: | 20221213141903272 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141903272 DLGLOBAL DEBUG validating counter group 0x7f148de3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141903272 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141903272 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141903273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141903273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141903274 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141903275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141903275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141903275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:19:04.268433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30710): Terminating (SIGTERM) 14:19:04.310127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30713): Terminating (SIGTERM) 14:19:04.352125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30716): Terminating (SIGTERM) 14:19:04.394301 --- ParallelTerminationStrategy: PID 30710 died... 14:19:04.414860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30710): Terminated: ok {rc=0} 14:19:04.461484 --- ParallelTerminationStrategy: PID 30713 died... 14:19:04.481277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30713): Terminated: ok {rc=0} 14:19:04.527905 --- ParallelTerminationStrategy: PID 30716 died... 14:19:04.547459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30716): Terminated: ok {rc=0} 14:19:04.636690 bus /sierra_3: Setting Powered False 14:19:05.735356 bus /sierra_3: Setting Powered False 14:19:06.850829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 14:19:08.090957 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:19:08.096059 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:19:08.135863 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:19:08.162800 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:19:08.217660 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:19:08.258530 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:19:08.286100 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:19:08.835924 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 14:19:08.841436 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:08.852206 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:19:08.889909 tst handover.py: using LAC 34516 14:19:09.010475 tst handover.py: using RAC 91 14:19:09.135137 tst handover.py: using CellId 34516 14:19:09.258659 tst handover.py: using BVCI 34517 14:19:09.371939 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:19:09.406208 tst handover.py: using LAC 34517 14:19:09.527263 tst handover.py: using RAC 92 14:19:09.652834 tst handover.py: using CellId 34517 14:19:09.775637 tst handover.py: using BVCI 34518 14:19:09.889665 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:09.900367 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:09.911123 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:09.921730 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:09.932462 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:19:09.943099 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:19:10.064931 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:19:10.187984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:19:10.673231 run create_hlr_db(pid=30724): Launched 14:19:10.810149 bus /sierra_2: Setting Powered False 14:19:11.875766 run create_hlr_db(pid=30724): Terminated: ok {rc=0} 14:19:12.307834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Launched 14:19:12.643318 run osmo-hlr_10.42.42.2(pid=30727): Launched 14:19:12.770505 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:13.311644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Launched 14:19:13.644148 run osmo-stp_10.42.42.5(pid=30730): Launched 14:19:13.772211 run osmo-msc_10.42.42.6: Starting osmo-msc 14:19:14.342850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Launched 14:19:14.677665 run osmo-msc_10.42.42.6(pid=30733): Launched 14:19:14.864685 run osmo-stp_10.42.42.5(pid=30730): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] 14:19:15.005177 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-13_14:19:13.583308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:15.147069 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221213141913773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141913773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141913774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141913774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141913775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141913775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141913775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:15.286395 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-13_14:19:13.583308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:15.419461 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221213141913773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141913773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141913774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141913774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141913775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141913775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141913775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:15.578151 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 14:19:15.587198 tst handover.py:18: Test FAILED (6.7 sec) 14:19:15.614903 run osmo-hlr_10.42.42.2(pid=30727): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30727)] 14:19:15.665954 run osmo-hlr_10.42.42.2(pid=30727): stdout: | (launched: 2022-12-13_14:19:12.581717) 14:19:15.718094 run osmo-hlr_10.42.42.2(pid=30727): stderr: | 20221213141912779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141912779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141912779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141912779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141912779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141912779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141912792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141912800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141912801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141912801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:19:15.790794 run osmo-msc_10.42.42.6(pid=30733): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30733)] 14:19:15.846923 run osmo-msc_10.42.42.6(pid=30733): stdout: | (launched: 2022-12-13_14:19:14.615806) 14:19:15.924311 run osmo-msc_10.42.42.6(pid=30733): stderr: | 20221213141914936 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141914936 DLGLOBAL DEBUG validating counter group 0x7f474518bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141914936 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141914936 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141914936 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141914937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141914938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141914939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141914939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141914939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:19:15.979554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminating (SIGTERM) 14:19:16.025817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminating (SIGTERM) 14:19:16.070758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Terminating (SIGTERM) 14:19:16.116939 --- ParallelTerminationStrategy: PID 30726 died... 14:19:16.137974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminated: ok {rc=0} 14:19:16.186075 --- ParallelTerminationStrategy: PID 30729 died... 14:19:16.206472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminated: ok {rc=0} 14:19:16.253263 --- ParallelTerminationStrategy: PID 30732 died... 14:19:16.273792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Terminated: ok {rc=0} 14:19:16.368841 bus /sierra_3: Setting Powered False 14:19:17.477675 bus /sierra_3: Setting Powered False 14:19:18.593963 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 14:19:19.844528 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:19:19.850244 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:19:19.906126 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:19:19.933445 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:19:19.986138 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:19:20.040704 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:19:20.067806 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:19:20.620416 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 14:19:20.626285 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:20.637783 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:19:20.678254 tst handover.py: using LAC 34518 14:19:20.809377 tst handover.py: using RAC 93 14:19:20.941309 tst handover.py: using CellId 34518 14:19:21.072699 tst handover.py: using BVCI 34519 14:19:21.194147 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:19:21.244267 tst handover.py: using LAC 34519 14:19:21.375960 tst handover.py: using RAC 94 14:19:21.507563 tst handover.py: using CellId 34519 14:19:21.638827 tst handover.py: using BVCI 34520 14:19:21.759603 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:21.771130 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:21.782463 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:21.793858 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:21.805672 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:19:21.817354 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:19:21.934849 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:19:22.056785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:19:22.539335 run create_hlr_db(pid=30738): Launched 14:19:22.676164 bus /sierra_2: Setting Powered False 14:19:23.741629 run create_hlr_db(pid=30738): Terminated: ok {rc=0} 14:19:24.155624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Launched 14:19:24.466091 run osmo-hlr_10.42.42.2(pid=30741): Launched 14:19:24.584314 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:25.088335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Launched 14:19:25.398858 run osmo-stp_10.42.42.5(pid=30744): Launched 14:19:25.517194 run osmo-msc_10.42.42.6: Starting osmo-msc 14:19:26.050509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Launched 14:19:26.360194 run osmo-msc_10.42.42.6(pid=30747): Launched 14:19:26.533637 run osmo-stp_10.42.42.5(pid=30744): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] 14:19:26.664233 run osmo-stp_10.42.42.5(pid=30744): stdout: | (launched: 2022-12-13_14:19:25.341313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:26.794408 run osmo-stp_10.42.42.5(pid=30744): stderr: | 20221213141925510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141925510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141925511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141925511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141925511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141925511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141925512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:26.923056 run osmo-stp_10.42.42.5(pid=30744): stdout: | (launched: 2022-12-13_14:19:25.341313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:27.045262 run osmo-stp_10.42.42.5(pid=30744): stderr: | 20221213141925510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141925510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141925511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141925511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141925511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141925511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141925512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:27.192762 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30744): Process ended prematurely: osmo-stp_10.42.42.5(pid=30744) [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 14:19:27.201320 tst handover.py:18: Test FAILED (6.6 sec) 14:19:27.227487 run osmo-hlr_10.42.42.2(pid=30741): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30741)] 14:19:27.274990 run osmo-hlr_10.42.42.2(pid=30741): stdout: | (launched: 2022-12-13_14:19:24.408271) 14:19:27.324113 run osmo-hlr_10.42.42.2(pid=30741): stderr: | 20221213141924583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141924583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141924583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141924584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141924584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141924584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141924596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141924604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141924604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141924604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:19:27.392660 run osmo-msc_10.42.42.6(pid=30747): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30747)] 14:19:27.439948 run osmo-msc_10.42.42.6(pid=30747): stdout: | (launched: 2022-12-13_14:19:26.303364) 14:19:27.488577 run osmo-msc_10.42.42.6(pid=30747): stderr: | 20221213141926575 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141926576 DLGLOBAL DEBUG validating counter group 0x7f945ab7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141926576 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141926576 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141926576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141926576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141926578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141926578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141926578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141926578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:19:27.538081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Terminating (SIGTERM) 14:19:27.578298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Terminating (SIGTERM) 14:19:27.619293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Terminating (SIGTERM) 14:19:27.659700 --- ParallelTerminationStrategy: PID 30740 died... 14:19:27.679254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Terminated: ok {rc=0} 14:19:27.723349 --- ParallelTerminationStrategy: PID 30743 died... 14:19:27.742318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Terminated: ok {rc=0} 14:19:27.786434 --- ParallelTerminationStrategy: PID 30746 died... 14:19:27.805507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Terminated: ok {rc=0} 14:19:27.892180 bus /sierra_3: Setting Powered False 14:19:28.991557 bus /sierra_3: Setting Powered False 14:19:30.108915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:19:31.377005 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:19:31.383104 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:19:31.437603 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:19:31.466210 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:19:31.527509 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:19:31.585308 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:19:31.613359 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:19:32.154008 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:19:32.162801 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:32.174639 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:19:32.213831 tst handover.py: using LAC 34520 14:19:32.342804 tst handover.py: using RAC 95 14:19:32.473951 tst handover.py: using CellId 34520 14:19:32.603743 tst handover.py: using BVCI 34521 14:19:32.725143 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:19:32.771701 tst handover.py: using LAC 34521 14:19:32.901873 tst handover.py: using RAC 96 14:19:33.025323 tst handover.py: using CellId 34521 14:19:33.150062 tst handover.py: using BVCI 34522 14:19:33.271557 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:33.283396 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:33.295308 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:33.307025 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:33.319202 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:19:33.331570 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:19:33.454516 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:19:33.577239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:19:34.059617 run create_hlr_db(pid=30752): Launched 14:19:34.194717 bus /sierra_2: Setting Powered False 14:19:35.259043 run create_hlr_db(pid=30752): Terminated: ok {rc=0} 14:19:35.673295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30754): Launched 14:19:35.983397 run osmo-hlr_10.42.42.2(pid=30755): Launched 14:19:36.101551 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:36.610466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30757): Launched 14:19:36.920387 run osmo-stp_10.42.42.5(pid=30758): Launched 14:19:37.039272 run osmo-msc_10.42.42.6: Starting osmo-msc 14:19:37.599281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30760): Launched 14:19:37.930231 run osmo-msc_10.42.42.6(pid=30761): Launched 14:19:38.115892 run osmo-stp_10.42.42.5(pid=30758): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30758)] 14:19:38.255087 run osmo-stp_10.42.42.5(pid=30758): stdout: | (launched: 2022-12-13_14:19:36.862581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:38.394344 run osmo-stp_10.42.42.5(pid=30758): stderr: | 20221213141937032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141937032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141937032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141937033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141937033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141937033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141937033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:38.532407 run osmo-stp_10.42.42.5(pid=30758): stdout: | (launched: 2022-12-13_14:19:36.862581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:38.663356 run osmo-stp_10.42.42.5(pid=30758): stderr: | 20221213141937032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141937032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141937032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141937033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141937033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141937033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141937033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:38.820034 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30758): Process ended prematurely: osmo-stp_10.42.42.5(pid=30758) [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30758)] [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 14:19:38.829200 tst handover.py:18: Test FAILED (6.7 sec) 14:19:38.856619 run osmo-hlr_10.42.42.2(pid=30755): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30755)] 14:19:38.906366 run osmo-hlr_10.42.42.2(pid=30755): stdout: | (launched: 2022-12-13_14:19:35.926280) 14:19:38.957966 run osmo-hlr_10.42.42.2(pid=30755): stderr: | 20221213141936099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141936099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141936100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141936100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141936100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141936100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141936114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141936122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141936122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141936122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:19:39.029506 run osmo-msc_10.42.42.6(pid=30761): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30761)] 14:19:39.079235 run osmo-msc_10.42.42.6(pid=30761): stdout: | (launched: 2022-12-13_14:19:37.869659) 14:19:39.130434 run osmo-msc_10.42.42.6(pid=30761): stderr: | 20221213141938189 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141938190 DLGLOBAL DEBUG validating counter group 0x7f033c176c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141938190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141938190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141938190 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141938190 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141938192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141938192 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141938192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141938192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:19:39.182181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30754): Terminating (SIGTERM) 14:19:39.223884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30757): Terminating (SIGTERM) 14:19:39.265541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30760): Terminating (SIGTERM) 14:19:39.307893 --- ParallelTerminationStrategy: PID 30754 died... 14:19:39.328020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30754): Terminated: ok {rc=0} 14:19:39.374328 --- ParallelTerminationStrategy: PID 30757 died... 14:19:39.394045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30757): Terminated: ok {rc=0} 14:19:39.440412 --- ParallelTerminationStrategy: PID 30760 died... 14:19:39.460098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30760): Terminated: ok {rc=0} 14:19:39.547920 bus /sierra_3: Setting Powered False 14:19:40.647177 bus /sierra_3: Setting Powered False 14:19:41.763484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:19:43.024805 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:19:43.030680 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:19:43.087001 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:19:43.114407 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:19:43.170637 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:19:43.225480 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:19:43.251904 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:19:43.806463 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:19:43.811922 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:43.823600 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:19:43.862293 tst handover.py: using LAC 34522 14:19:43.993499 tst handover.py: using RAC 97 14:19:44.116757 tst handover.py: using CellId 34522 14:19:44.239929 tst handover.py: using BVCI 34523 14:19:44.354294 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:19:44.403606 tst handover.py: using LAC 34523 14:19:44.529029 tst handover.py: using RAC 98 14:19:44.652940 tst handover.py: using CellId 34523 14:19:44.776560 tst handover.py: using BVCI 34524 14:19:44.890960 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:44.902079 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:44.912862 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:44.923807 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:44.935473 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:19:44.947379 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:19:45.069406 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:19:45.187909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:19:45.641090 run create_hlr_db(pid=30767): Launched 14:19:45.759273 bus /sierra_2: Setting Powered False 14:19:46.819073 run create_hlr_db(pid=30767): Terminated: ok {rc=0} 14:19:47.228581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Launched 14:19:47.553399 run osmo-hlr_10.42.42.2(pid=30770): Launched 14:19:47.673098 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:48.179217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Launched 14:19:48.488008 run osmo-stp_10.42.42.5(pid=30773): Launched 14:19:48.607024 run osmo-msc_10.42.42.6: Starting osmo-msc 14:19:49.141475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Launched 14:19:49.453667 run osmo-msc_10.42.42.6(pid=30776): Launched 14:19:49.627896 run osmo-stp_10.42.42.5(pid=30773): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] 14:19:49.759133 run osmo-stp_10.42.42.5(pid=30773): stdout: | (launched: 2022-12-13_14:19:48.431381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:49.890311 run osmo-stp_10.42.42.5(pid=30773): stderr: | 20221213141948598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141948599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141948599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141948599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141948600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141948600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141948600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:50.019370 run osmo-stp_10.42.42.5(pid=30773): stdout: | (launched: 2022-12-13_14:19:48.431381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:19:50.142435 run osmo-stp_10.42.42.5(pid=30773): stderr: | 20221213141948598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213141948599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213141948599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213141948599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213141948600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213141948600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213141948600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:19:50.290078 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30773): Process ended prematurely: osmo-stp_10.42.42.5(pid=30773) [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 14:19:50.298618 tst handover.py:18: Test FAILED (6.5 sec) 14:19:50.325034 run osmo-hlr_10.42.42.2(pid=30770): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30770)] 14:19:50.373206 run osmo-hlr_10.42.42.2(pid=30770): stdout: | (launched: 2022-12-13_14:19:47.495782) 14:19:50.422603 run osmo-hlr_10.42.42.2(pid=30770): stderr: | 20221213141947670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141947670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141947670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141947670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141947670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141947670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141947706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141947716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141947717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141947717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:19:50.491748 run osmo-msc_10.42.42.6(pid=30776): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30776)] 14:19:50.539054 run osmo-msc_10.42.42.6(pid=30776): stdout: | (launched: 2022-12-13_14:19:49.396337) 14:19:50.589147 run osmo-msc_10.42.42.6(pid=30776): stderr: | 20221213141949665 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213141949666 DLGLOBAL DEBUG validating counter group 0x7f4d0aa6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213141949666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213141949666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213141949666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213141949666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213141949668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213141949668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213141949668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213141949668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:19:50.638893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Terminating (SIGTERM) 14:19:50.678952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Terminating (SIGTERM) 14:19:50.718868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Terminating (SIGTERM) 14:19:50.759613 --- ParallelTerminationStrategy: PID 30769 died... 14:19:50.779124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Terminated: ok {rc=0} 14:19:50.823268 --- ParallelTerminationStrategy: PID 30772 died... 14:19:50.842242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Terminated: ok {rc=0} 14:19:50.886101 --- ParallelTerminationStrategy: PID 30775 died... 14:19:50.905117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Terminated: ok {rc=0} 14:19:50.990058 bus /sierra_3: Setting Powered False 14:19:52.086229 bus /sierra_3: Setting Powered False 14:19:53.205093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 14:19:54.476477 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:19:54.482049 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:19:54.524634 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:19:54.552089 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:19:54.603081 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:19:54.645470 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:19:54.672788 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:19:55.226913 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 14:19:55.232548 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:55.243778 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:19:55.282550 tst handover.py: using LAC 34524 14:19:55.410755 tst handover.py: using RAC 99 14:19:55.539955 tst handover.py: using CellId 34524 14:19:55.672143 tst handover.py: using BVCI 34525 14:19:55.793192 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:19:55.827976 tst handover.py: using LAC 34525 14:19:55.954254 tst handover.py: using RAC 100 14:19:56.081415 tst handover.py: using CellId 34525 14:19:56.201416 tst handover.py: using BVCI 34526 14:19:56.313689 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:56.324523 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:56.335420 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:56.346328 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:56.358114 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:19:56.369883 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:19:56.495139 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:19:56.612719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:19:57.066155 run create_hlr_db(pid=30781): Launched 14:19:57.184529 bus /sierra_2: Setting Powered False 14:19:58.245515 run create_hlr_db(pid=30781): Terminated: ok {rc=0} 14:19:58.649381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30783): Launched 14:19:58.960608 run osmo-hlr_10.42.42.2(pid=30784): Launched 14:19:59.078486 run osmo-stp_10.42.42.5: Starting osmo-stp 14:19:59.586112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30786): Launched 14:19:59.895432 run osmo-stp_10.42.42.5(pid=30787): Launched 14:20:00.013964 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:00.545954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30789): Launched 14:20:00.861631 run osmo-msc_10.42.42.6(pid=30790): Launched 14:20:01.150647 run osmo-stp_10.42.42.5(pid=30787): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30787)] 14:20:01.338400 run osmo-stp_10.42.42.5(pid=30787): stdout: | (launched: 2022-12-13_14:19:59.838609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:01.610820 run osmo-stp_10.42.42.5(pid=30787): stderr: | 20221213142000004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142000005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142000005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142000005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142000006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142000006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142000006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:01.763870 run osmo-stp_10.42.42.5(pid=30787): stdout: | (launched: 2022-12-13_14:19:59.838609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:01.912922 run osmo-stp_10.42.42.5(pid=30787): stderr: | 20221213142000004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142000005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142000005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142000005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142000006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142000006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142000006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:02.067737 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30787): Process ended prematurely: osmo-stp_10.42.42.5(pid=30787) [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30787)] [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 14:20:02.077154 tst handover.py:18: Test FAILED (6.8 sec) 14:20:02.104523 run osmo-hlr_10.42.42.2(pid=30784): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30784)] 14:20:02.156720 run osmo-hlr_10.42.42.2(pid=30784): stdout: | (launched: 2022-12-13_14:19:58.902891) 14:20:02.208359 run osmo-hlr_10.42.42.2(pid=30784): stderr: | 20221213141959077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213141959077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213141959077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213141959077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213141959077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213141959077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213141959091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213141959099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213141959099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213141959099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:20:02.279873 run osmo-msc_10.42.42.6(pid=30790): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30790)] 14:20:02.328435 run osmo-msc_10.42.42.6(pid=30790): stdout: | (launched: 2022-12-13_14:20:00.799167) 14:20:02.381343 run osmo-msc_10.42.42.6(pid=30790): stderr: | 20221213142001303 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142001303 DLGLOBAL DEBUG validating counter group 0x7f2dcbf5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142001303 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142001303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142001304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142001304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142001315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142001316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142001316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142001316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:20:02.433517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30783): Terminating (SIGTERM) 14:20:02.474291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30786): Terminating (SIGTERM) 14:20:02.515947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30789): Terminating (SIGTERM) 14:20:02.558412 --- ParallelTerminationStrategy: PID 30783 died... 14:20:02.577716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30783): Terminated: ok {rc=0} 14:20:02.621293 --- ParallelTerminationStrategy: PID 30786 died... 14:20:02.639976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30786): Terminated: ok {rc=0} 14:20:02.683669 --- ParallelTerminationStrategy: PID 30789 died... 14:20:02.702469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30789): Terminated: ok {rc=0} 14:20:02.788403 bus /sierra_3: Setting Powered False 14:20:03.886641 bus /sierra_3: Setting Powered False 14:20:04.999144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 14:20:06.247264 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:20:06.252510 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:20:06.306488 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:20:06.332756 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:20:06.384388 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:20:06.437337 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:20:06.463453 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:20:07.019422 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 14:20:07.025978 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:07.037880 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:20:07.078466 tst handover.py: using LAC 34526 14:20:07.202474 tst handover.py: using RAC 101 14:20:07.329450 tst handover.py: using CellId 34526 14:20:07.459719 tst handover.py: using BVCI 34527 14:20:07.574634 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:20:07.621473 tst handover.py: using LAC 34527 14:20:07.742950 tst handover.py: using RAC 102 14:20:07.863971 tst handover.py: using CellId 34527 14:20:07.984149 tst handover.py: using BVCI 34528 14:20:08.096364 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:08.107366 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:08.118159 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:08.128767 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:08.139845 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:20:08.150836 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:20:08.271980 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:20:08.395419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:20:08.880096 run create_hlr_db(pid=30798): Launched 14:20:09.014405 bus /sierra_2: Setting Powered False 14:20:10.080215 run create_hlr_db(pid=30798): Terminated: ok {rc=0} 14:20:10.511892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Launched 14:20:10.843183 run osmo-hlr_10.42.42.2(pid=30801): Launched 14:20:10.969249 run osmo-stp_10.42.42.5: Starting osmo-stp 14:20:11.511481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Launched 14:20:11.842764 run osmo-stp_10.42.42.5(pid=30804): Launched 14:20:11.970295 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:12.539526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30806): Launched 14:20:12.872404 run osmo-msc_10.42.42.6(pid=30807): Launched 14:20:13.056496 run osmo-stp_10.42.42.5(pid=30804): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] 14:20:13.195587 run osmo-stp_10.42.42.5(pid=30804): stdout: | (launched: 2022-12-13_14:20:11.782430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:13.335071 run osmo-stp_10.42.42.5(pid=30804): stderr: | 20221213142011971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142011971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142011972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142011972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142011973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142011973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142011973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:13.472543 run osmo-stp_10.42.42.5(pid=30804): stdout: | (launched: 2022-12-13_14:20:11.782430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:13.604283 run osmo-stp_10.42.42.5(pid=30804): stderr: | 20221213142011971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142011971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142011972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142011972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142011973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142011973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142011973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:13.761416 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30804): Process ended prematurely: osmo-stp_10.42.42.5(pid=30804) [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 14:20:13.770628 tst handover.py:18: Test FAILED (6.7 sec) 14:20:13.798183 run osmo-hlr_10.42.42.2(pid=30801): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30801)] 14:20:13.848654 run osmo-hlr_10.42.42.2(pid=30801): stdout: | (launched: 2022-12-13_14:20:10.782218) 14:20:13.900526 run osmo-hlr_10.42.42.2(pid=30801): stderr: | 20221213142010978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142010978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142010978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142010978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142010978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142010978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142010990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142010999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142010999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142010999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:20:13.972902 run osmo-msc_10.42.42.6(pid=30807): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30807)] 14:20:14.023132 run osmo-msc_10.42.42.6(pid=30807): stdout: | (launched: 2022-12-13_14:20:12.811793) 14:20:14.074926 run osmo-msc_10.42.42.6(pid=30807): stderr: | 20221213142013132 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142013132 DLGLOBAL DEBUG validating counter group 0x7fd8b8e45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142013132 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142013132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142013132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142013132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142013134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142013134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142013135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142013135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:20:14.127109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Terminating (SIGTERM) 14:20:14.169280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Terminating (SIGTERM) 14:20:14.211280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30806): Terminating (SIGTERM) 14:20:14.253777 --- ParallelTerminationStrategy: PID 30800 died... 14:20:14.273882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Terminated: ok {rc=0} 14:20:14.320411 --- ParallelTerminationStrategy: PID 30803 died... 14:20:14.340003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Terminated: ok {rc=0} 14:20:14.386364 --- ParallelTerminationStrategy: PID 30806 died... 14:20:14.406094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30806): Terminated: ok {rc=0} 14:20:14.494261 bus /sierra_3: Setting Powered False 14:20:15.595995 bus /sierra_3: Setting Powered False 14:20:16.723620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 14:20:17.997706 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:20:18.003364 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:20:18.057481 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:20:18.084726 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:20:18.137845 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:20:18.192101 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:20:18.219341 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:20:18.771755 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 14:20:18.777509 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:18.788750 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:20:18.829079 tst handover.py: using LAC 34528 14:20:18.959925 tst handover.py: using RAC 103 14:20:19.091243 tst handover.py: using CellId 34528 14:20:19.222306 tst handover.py: using BVCI 34529 14:20:19.343389 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:20:19.392689 tst handover.py: using LAC 34529 14:20:19.522409 tst handover.py: using RAC 104 14:20:19.651576 tst handover.py: using CellId 34529 14:20:19.780798 tst handover.py: using BVCI 34530 14:20:19.900862 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:19.912549 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:19.923940 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:19.935193 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:19.946700 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:20:19.958158 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:20:20.075601 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:20:20.197244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:20:20.681320 run create_hlr_db(pid=30812): Launched 14:20:20.816321 bus /sierra_2: Setting Powered False 14:20:21.882092 run create_hlr_db(pid=30812): Terminated: ok {rc=0} 14:20:22.296878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30814): Launched 14:20:22.607454 run osmo-hlr_10.42.42.2(pid=30815): Launched 14:20:22.725506 run osmo-stp_10.42.42.5: Starting osmo-stp 14:20:23.239960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30817): Launched 14:20:23.552828 run osmo-stp_10.42.42.5(pid=30818): Launched 14:20:23.671433 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:24.203853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30820): Launched 14:20:24.514812 run osmo-msc_10.42.42.6(pid=30821): Launched 14:20:24.688079 run osmo-stp_10.42.42.5(pid=30818): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30818)] 14:20:24.819212 run osmo-stp_10.42.42.5(pid=30818): stdout: | (launched: 2022-12-13_14:20:23.495601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:24.949496 run osmo-stp_10.42.42.5(pid=30818): stderr: | 20221213142023665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142023665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142023665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142023665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142023666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142023666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142023666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:25.078034 run osmo-stp_10.42.42.5(pid=30818): stdout: | (launched: 2022-12-13_14:20:23.495601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:25.200848 run osmo-stp_10.42.42.5(pid=30818): stderr: | 20221213142023665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142023665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142023665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142023665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142023666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142023666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142023666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:25.347558 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30818): Process ended prematurely: osmo-stp_10.42.42.5(pid=30818) [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30818)] [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 14:20:25.355940 tst handover.py:18: Test FAILED (6.6 sec) 14:20:25.381954 run osmo-hlr_10.42.42.2(pid=30815): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30815)] 14:20:25.429774 run osmo-hlr_10.42.42.2(pid=30815): stdout: | (launched: 2022-12-13_14:20:22.549813) 14:20:25.479128 run osmo-hlr_10.42.42.2(pid=30815): stderr: | 20221213142022724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142022724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142022724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142022725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142022725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142022725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142022737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142022745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142022745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142022745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:20:25.548089 run osmo-msc_10.42.42.6(pid=30821): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30821)] 14:20:25.595207 run osmo-msc_10.42.42.6(pid=30821): stdout: | (launched: 2022-12-13_14:20:24.457812) 14:20:25.644375 run osmo-msc_10.42.42.6(pid=30821): stderr: | 20221213142024727 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142024727 DLGLOBAL DEBUG validating counter group 0x7f5c946b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142024727 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142024727 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142024727 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142024727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142024729 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142024729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142024730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142024730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:20:25.693884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30814): Terminating (SIGTERM) 14:20:25.733604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30817): Terminating (SIGTERM) 14:20:25.773421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30820): Terminating (SIGTERM) 14:20:25.813774 --- ParallelTerminationStrategy: PID 30814 died... 14:20:25.833167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30814): Terminated: ok {rc=0} 14:20:25.877196 --- ParallelTerminationStrategy: PID 30817 died... 14:20:25.895982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30817): Terminated: ok {rc=0} 14:20:25.940450 --- ParallelTerminationStrategy: PID 30820 died... 14:20:25.959562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30820): Terminated: ok {rc=0} 14:20:26.047274 bus /sierra_3: Setting Powered False 14:20:27.149940 bus /sierra_3: Setting Powered False 14:20:28.269555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 14:20:29.536693 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:20:29.542518 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:20:29.580263 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:20:29.607765 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:20:29.661226 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:20:29.699064 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:20:29.726472 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:20:30.279196 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 14:20:30.285057 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:30.296431 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:20:30.332177 tst handover.py: using LAC 34530 14:20:30.461447 tst handover.py: using RAC 105 14:20:30.591665 tst handover.py: using CellId 34530 14:20:30.714247 tst handover.py: using BVCI 34531 14:20:30.828651 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:20:30.882161 tst handover.py: using LAC 34531 14:20:31.026743 tst handover.py: using RAC 106 14:20:31.151958 tst handover.py: using CellId 34531 14:20:31.294184 tst handover.py: using BVCI 34532 14:20:31.450190 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:31.462882 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:31.475332 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:31.487976 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:31.500650 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:20:31.513646 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:20:31.637998 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:20:31.803831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:20:32.312654 run create_hlr_db(pid=30827): Launched 14:20:32.448001 bus /sierra_2: Setting Powered False 14:20:33.513303 run create_hlr_db(pid=30827): Terminated: ok {rc=0} 14:20:33.927982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30829): Launched 14:20:34.238305 run osmo-hlr_10.42.42.2(pid=30830): Launched 14:20:34.357656 run osmo-stp_10.42.42.5: Starting osmo-stp 14:20:34.876722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30832): Launched 14:20:35.186462 run osmo-stp_10.42.42.5(pid=30833): Launched 14:20:35.305394 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:35.839539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30835): Launched 14:20:36.150173 run osmo-msc_10.42.42.6(pid=30836): Launched 14:20:36.323050 run osmo-stp_10.42.42.5(pid=30833): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30833)] 14:20:36.453777 run osmo-stp_10.42.42.5(pid=30833): stdout: | (launched: 2022-12-13_14:20:35.129754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:36.584575 run osmo-stp_10.42.42.5(pid=30833): stderr: | 20221213142035297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142035297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142035298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142035298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142035299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142035299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142035299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:36.713913 run osmo-stp_10.42.42.5(pid=30833): stdout: | (launched: 2022-12-13_14:20:35.129754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:36.836824 run osmo-stp_10.42.42.5(pid=30833): stderr: | 20221213142035297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142035297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142035298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142035298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142035299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142035299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142035299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:36.983934 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30833): Process ended prematurely: osmo-stp_10.42.42.5(pid=30833) [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30833)] [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 14:20:36.992485 tst handover.py:18: Test FAILED (6.7 sec) 14:20:37.018648 run osmo-hlr_10.42.42.2(pid=30830): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30830)] 14:20:37.066785 run osmo-hlr_10.42.42.2(pid=30830): stdout: | (launched: 2022-12-13_14:20:34.180653) 14:20:37.116531 run osmo-hlr_10.42.42.2(pid=30830): stderr: | 20221213142034355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142034356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142034356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142034356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142034356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142034356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142034371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142034380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142034380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142034380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:20:37.185060 run osmo-msc_10.42.42.6(pid=30836): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30836)] 14:20:37.232107 run osmo-msc_10.42.42.6(pid=30836): stdout: | (launched: 2022-12-13_14:20:36.093312) 14:20:37.281336 run osmo-msc_10.42.42.6(pid=30836): stderr: | 20221213142036360 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142036361 DLGLOBAL DEBUG validating counter group 0x7ff94cc1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142036361 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142036361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142036361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142036361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142036363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142036364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142036364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142036364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:20:37.331095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30829): Terminating (SIGTERM) 14:20:37.370940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30832): Terminating (SIGTERM) 14:20:37.410735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30835): Terminating (SIGTERM) 14:20:37.450695 --- ParallelTerminationStrategy: PID 30829 died... 14:20:37.470282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30829): Terminated: ok {rc=0} 14:20:37.514449 --- ParallelTerminationStrategy: PID 30832 died... 14:20:37.533490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30832): Terminated: ok {rc=0} 14:20:37.577400 --- ParallelTerminationStrategy: PID 30835 died... 14:20:37.596191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30835): Terminated: ok {rc=0} 14:20:37.683109 bus /sierra_3: Setting Powered False 14:20:38.781367 bus /sierra_3: Setting Powered False 14:20:39.895752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 14:20:41.141434 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:20:41.147165 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:20:41.198489 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:20:41.225623 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:20:41.278739 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:20:41.330347 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:20:41.357538 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:20:41.913473 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 14:20:41.920394 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:41.942612 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:20:41.979034 tst handover.py: using LAC 34532 14:20:42.107725 tst handover.py: using RAC 107 14:20:42.238032 tst handover.py: using CellId 34532 14:20:42.368726 tst handover.py: using BVCI 34533 14:20:42.490829 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:20:42.540100 tst handover.py: using LAC 34533 14:20:42.663507 tst handover.py: using RAC 108 14:20:42.786567 tst handover.py: using CellId 34533 14:20:42.908987 tst handover.py: using BVCI 34534 14:20:43.029385 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:43.040812 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:43.052483 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:43.063819 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:43.075233 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:20:43.086538 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:20:43.204420 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:20:43.325803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:20:43.809948 run create_hlr_db(pid=30842): Launched 14:20:43.947212 bus /sierra_2: Setting Powered False 14:20:45.012487 run create_hlr_db(pid=30842): Terminated: ok {rc=0} 14:20:45.444204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Launched 14:20:45.778058 run osmo-hlr_10.42.42.2(pid=30845): Launched 14:20:45.992126 run osmo-stp_10.42.42.5: Starting osmo-stp 14:20:46.613733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Launched 14:20:46.937374 run osmo-stp_10.42.42.5(pid=30848): Launched 14:20:47.183290 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:47.776233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Launched 14:20:48.108203 run osmo-msc_10.42.42.6(pid=30851): Launched 14:20:48.293221 run osmo-stp_10.42.42.5(pid=30848): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] 14:20:48.435225 run osmo-stp_10.42.42.5(pid=30848): stdout: | (launched: 2022-12-13_14:20:46.877794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:48.569566 run osmo-stp_10.42.42.5(pid=30848): stderr: | 20221213142047203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142047203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142047203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142047204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142047204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142047204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142047209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:48.698268 run osmo-stp_10.42.42.5(pid=30848): stdout: | (launched: 2022-12-13_14:20:46.877794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:20:48.821453 run osmo-stp_10.42.42.5(pid=30848): stderr: | 20221213142047203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142047203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142047203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142047204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142047204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142047204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142047209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:20:48.968003 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30848): Process ended prematurely: osmo-stp_10.42.42.5(pid=30848) [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 14:20:48.976386 tst handover.py:18: Test FAILED (7.0 sec) 14:20:49.002606 run osmo-hlr_10.42.42.2(pid=30845): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30845)] 14:20:49.050617 run osmo-hlr_10.42.42.2(pid=30845): stdout: | (launched: 2022-12-13_14:20:45.716756) 14:20:49.099749 run osmo-hlr_10.42.42.2(pid=30845): stderr: | 20221213142045974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142045974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142045974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142045974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142045974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142045974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142045991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142046006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142046006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142046006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:20:49.168731 run osmo-msc_10.42.42.6(pid=30851): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30851)] 14:20:49.216067 run osmo-msc_10.42.42.6(pid=30851): stdout: | (launched: 2022-12-13_14:20:48.047485) 14:20:49.265640 run osmo-msc_10.42.42.6(pid=30851): stderr: | 20221213142048369 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142048369 DLGLOBAL DEBUG validating counter group 0x7fbf31d7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142048369 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142048369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142048369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142048370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142048371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142048372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142048372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142048372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:20:49.315312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Terminating (SIGTERM) 14:20:49.355264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Terminating (SIGTERM) 14:20:49.394808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Terminating (SIGTERM) 14:20:49.434980 --- ParallelTerminationStrategy: PID 30844 died... 14:20:49.454347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Terminated: ok {rc=0} 14:20:49.498544 --- ParallelTerminationStrategy: PID 30847 died... 14:20:49.517620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Terminated: ok {rc=0} 14:20:49.561349 --- ParallelTerminationStrategy: PID 30850 died... 14:20:49.580130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Terminated: ok {rc=0} 14:20:49.666692 bus /sierra_3: Setting Powered False 14:20:50.765346 bus /sierra_3: Setting Powered False 14:20:51.882795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:20:53.143473 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:20:53.149409 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:20:53.197061 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:20:53.224777 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:20:53.279295 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:20:53.326314 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:20:53.352761 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:20:53.907208 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:20:53.913040 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:53.924632 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:20:53.959835 tst handover.py: using LAC 34534 14:20:54.089552 tst handover.py: using RAC 109 14:20:54.218694 tst handover.py: using CellId 34534 14:20:54.347794 tst handover.py: using BVCI 34535 14:20:54.467774 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:20:54.513815 tst handover.py: using LAC 34535 14:20:54.644451 tst handover.py: using RAC 110 14:20:54.773475 tst handover.py: using CellId 34535 14:20:54.902810 tst handover.py: using BVCI 34536 14:20:55.022533 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:55.034111 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:55.045506 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:55.056791 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:55.068270 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:20:55.079620 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:20:55.198212 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:20:55.320407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:20:55.805386 run create_hlr_db(pid=30857): Launched 14:20:55.940757 bus /sierra_2: Setting Powered False 14:20:57.006428 run create_hlr_db(pid=30857): Terminated: ok {rc=0} 14:20:57.423475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Launched 14:20:57.737364 run osmo-hlr_10.42.42.2(pid=30860): Launched 14:20:57.856560 run osmo-stp_10.42.42.5: Starting osmo-stp 14:20:58.377728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Launched 14:20:58.687997 run osmo-stp_10.42.42.5(pid=30863): Launched 14:20:58.806761 run osmo-msc_10.42.42.6: Starting osmo-msc 14:20:59.340695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Launched 14:20:59.652466 run osmo-msc_10.42.42.6(pid=30866): Launched 14:20:59.826835 run osmo-stp_10.42.42.5(pid=30863): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] 14:20:59.959211 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-13_14:20:58.631243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:00.090786 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221213142058800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142058801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142058801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142058801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142058802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142058802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142058802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:00.220522 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-13_14:20:58.631243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:00.344122 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221213142058800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142058801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142058801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142058801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142058802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142058802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142058802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:00.491923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 14:21:00.500338 tst handover.py:18: Test FAILED (6.6 sec) 14:21:00.526931 run osmo-hlr_10.42.42.2(pid=30860): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30860)] 14:21:00.575522 run osmo-hlr_10.42.42.2(pid=30860): stdout: | (launched: 2022-12-13_14:20:57.679374) 14:21:00.625877 run osmo-hlr_10.42.42.2(pid=30860): stderr: | 20221213142057854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142057854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142057854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142057854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142057854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142057854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142057866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142057874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142057874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142057874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:00.695389 run osmo-msc_10.42.42.6(pid=30866): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30866)] 14:21:00.743135 run osmo-msc_10.42.42.6(pid=30866): stdout: | (launched: 2022-12-13_14:20:59.594986) 14:21:00.792627 run osmo-msc_10.42.42.6(pid=30866): stderr: | 20221213142059866 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142059866 DLGLOBAL DEBUG validating counter group 0x7fb51e85bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142059866 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142059866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142059866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142059866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142059868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142059868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142059869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142059869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:00.843719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminating (SIGTERM) 14:21:00.885716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminating (SIGTERM) 14:21:00.926589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Terminating (SIGTERM) 14:21:00.967557 --- ParallelTerminationStrategy: PID 30859 died... 14:21:00.987126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminated: ok {rc=0} 14:21:01.031948 --- ParallelTerminationStrategy: PID 30862 died... 14:21:01.051444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminated: ok {rc=0} 14:21:01.096308 --- ParallelTerminationStrategy: PID 30865 died... 14:21:01.116079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Terminated: ok {rc=0} 14:21:01.203446 bus /sierra_3: Setting Powered False 14:21:02.304925 bus /sierra_3: Setting Powered False 14:21:03.421670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:21:04.686980 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:21:04.693778 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:21:04.746681 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:21:04.774059 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:21:04.825899 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:21:04.877791 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:21:04.905078 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:21:05.461914 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:21:05.467884 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:05.479823 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:21:05.519558 tst handover.py: using LAC 34536 14:21:05.640388 tst handover.py: using RAC 111 14:21:05.760770 tst handover.py: using CellId 34536 14:21:05.880911 tst handover.py: using BVCI 34537 14:21:05.994234 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:21:06.042699 tst handover.py: using LAC 34537 14:21:06.165210 tst handover.py: using RAC 112 14:21:06.285254 tst handover.py: using CellId 34537 14:21:06.405240 tst handover.py: using BVCI 34538 14:21:06.519368 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:06.530646 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:06.541679 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:06.552474 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:06.563811 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:21:06.575063 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:21:06.696481 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:21:06.816375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:21:07.271898 run create_hlr_db(pid=30871): Launched 14:21:07.390947 bus /sierra_2: Setting Powered False 14:21:08.451841 run create_hlr_db(pid=30871): Terminated: ok {rc=0} 14:21:08.855861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Launched 14:21:09.166180 run osmo-hlr_10.42.42.2(pid=30874): Launched 14:21:09.283665 run osmo-stp_10.42.42.5: Starting osmo-stp 14:21:09.791514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Launched 14:21:10.104891 run osmo-stp_10.42.42.5(pid=30877): Launched 14:21:10.223464 run osmo-msc_10.42.42.6: Starting osmo-msc 14:21:10.755777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30879): Launched 14:21:11.067134 run osmo-msc_10.42.42.6(pid=30880): Launched 14:21:11.240793 run osmo-stp_10.42.42.5(pid=30877): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30877)] 14:21:11.377392 run osmo-stp_10.42.42.5(pid=30877): stdout: | (launched: 2022-12-13_14:21:10.047470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:11.508003 run osmo-stp_10.42.42.5(pid=30877): stderr: | 20221213142110217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142110217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142110218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142110218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142110218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142110218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142110219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:11.636921 run osmo-stp_10.42.42.5(pid=30877): stdout: | (launched: 2022-12-13_14:21:10.047470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:11.759755 run osmo-stp_10.42.42.5(pid=30877): stderr: | 20221213142110217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142110217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142110218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142110218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142110218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142110218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142110219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:11.906847 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30877): Process ended prematurely: osmo-stp_10.42.42.5(pid=30877) [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30877)] [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 14:21:11.915178 tst handover.py:18: Test FAILED (6.4 sec) 14:21:11.941371 run osmo-hlr_10.42.42.2(pid=30874): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30874)] 14:21:11.989524 run osmo-hlr_10.42.42.2(pid=30874): stdout: | (launched: 2022-12-13_14:21:09.108349) 14:21:12.039234 run osmo-hlr_10.42.42.2(pid=30874): stderr: | 20221213142109282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142109282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142109282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142109282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142109283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142109283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142109296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142109306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142109307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142109307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:12.108227 run osmo-msc_10.42.42.6(pid=30880): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30880)] 14:21:12.155930 run osmo-msc_10.42.42.6(pid=30880): stdout: | (launched: 2022-12-13_14:21:11.009924) 14:21:12.205313 run osmo-msc_10.42.42.6(pid=30880): stderr: | 20221213142111278 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142111278 DLGLOBAL DEBUG validating counter group 0x7f4649b29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142111278 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142111278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142111278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142111278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142111280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142111281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142111281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142111281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:12.255138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Terminating (SIGTERM) 14:21:12.295274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Terminating (SIGTERM) 14:21:12.335925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30879): Terminating (SIGTERM) 14:21:12.376420 --- ParallelTerminationStrategy: PID 30873 died... 14:21:12.396143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30873): Terminated: ok {rc=0} 14:21:12.440764 --- ParallelTerminationStrategy: PID 30876 died... 14:21:12.459874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30876): Terminated: ok {rc=0} 14:21:12.504243 --- ParallelTerminationStrategy: PID 30879 died... 14:21:12.523441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30879): Terminated: ok {rc=0} 14:21:12.608764 bus /sierra_3: Setting Powered False 14:21:13.708358 bus /sierra_3: Setting Powered False 14:21:14.824455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 14:21:16.109031 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:21:16.116700 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:21:16.168146 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:21:16.204893 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:21:16.263537 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:21:16.303240 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:21:16.332909 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:21:16.881355 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 14:21:16.888305 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:16.900484 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:21:16.940250 tst handover.py: using LAC 34538 14:21:17.104468 tst handover.py: using RAC 113 14:21:17.244184 tst handover.py: using CellId 34538 14:21:17.370122 tst handover.py: using BVCI 34539 14:21:17.484553 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:21:17.518151 tst handover.py: using LAC 34539 14:21:17.648209 tst handover.py: using RAC 114 14:21:17.778269 tst handover.py: using CellId 34539 14:21:17.908695 tst handover.py: using BVCI 34540 14:21:18.029832 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:18.041076 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:18.052233 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:18.063577 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:18.074829 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:21:18.086104 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:21:18.205115 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:21:18.328257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:21:18.815539 run create_hlr_db(pid=30885): Launched 14:21:18.950330 bus /sierra_2: Setting Powered False 14:21:20.014587 run create_hlr_db(pid=30885): Terminated: ok {rc=0} 14:21:20.432000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30887): Launched 14:21:20.743308 run osmo-hlr_10.42.42.2(pid=30888): Launched 14:21:20.863501 run osmo-stp_10.42.42.5: Starting osmo-stp 14:21:21.385897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30890): Launched 14:21:21.696513 run osmo-stp_10.42.42.5(pid=30891): Launched 14:21:21.815295 run osmo-msc_10.42.42.6: Starting osmo-msc 14:21:22.349114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30893): Launched 14:21:22.659499 run osmo-msc_10.42.42.6(pid=30894): Launched 14:21:22.834261 run osmo-stp_10.42.42.5(pid=30891): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30891)] 14:21:22.964856 run osmo-stp_10.42.42.5(pid=30891): stdout: | (launched: 2022-12-13_14:21:21.639449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:23.095254 run osmo-stp_10.42.42.5(pid=30891): stderr: | 20221213142121809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142121809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142121809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142121810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142121810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142121810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142121810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:23.224928 run osmo-stp_10.42.42.5(pid=30891): stdout: | (launched: 2022-12-13_14:21:21.639449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:23.347904 run osmo-stp_10.42.42.5(pid=30891): stderr: | 20221213142121809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142121809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142121809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142121810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142121810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142121810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142121810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:23.495995 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30891): Process ended prematurely: osmo-stp_10.42.42.5(pid=30891) [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30891)] [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 14:21:23.504388 tst handover.py:18: Test FAILED (6.6 sec) 14:21:23.530516 run osmo-hlr_10.42.42.2(pid=30888): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30888)] 14:21:23.579491 run osmo-hlr_10.42.42.2(pid=30888): stdout: | (launched: 2022-12-13_14:21:20.685686) 14:21:23.629544 run osmo-hlr_10.42.42.2(pid=30888): stderr: | 20221213142120859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142120859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142120859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142120859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142120859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142120859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142120870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142120879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142120879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142120879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:23.699708 run osmo-msc_10.42.42.6(pid=30894): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30894)] 14:21:23.746741 run osmo-msc_10.42.42.6(pid=30894): stdout: | (launched: 2022-12-13_14:21:22.602344) 14:21:23.796151 run osmo-msc_10.42.42.6(pid=30894): stderr: | 20221213142122873 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142122873 DLGLOBAL DEBUG validating counter group 0x7f19afac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142122874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142122874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142122874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142122874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142122876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142122876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142122876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142122876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:23.845883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30887): Terminating (SIGTERM) 14:21:23.886229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30890): Terminating (SIGTERM) 14:21:23.926443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30893): Terminating (SIGTERM) 14:21:23.967017 --- ParallelTerminationStrategy: PID 30887 died... 14:21:23.986616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30887): Terminated: ok {rc=0} 14:21:24.031348 --- ParallelTerminationStrategy: PID 30890 died... 14:21:24.050614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30890): Terminated: ok {rc=0} 14:21:24.094956 --- ParallelTerminationStrategy: PID 30893 died... 14:21:24.114590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30893): Terminated: ok {rc=0} 14:21:24.202167 bus /sierra_3: Setting Powered False 14:21:25.301790 bus /sierra_3: Setting Powered False 14:21:26.417555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 14:21:27.654573 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:21:27.661408 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:21:27.713219 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:21:27.740741 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:21:27.799977 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:21:27.852484 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:21:27.879858 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:21:28.427656 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 14:21:28.434374 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:28.446292 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:21:28.481591 tst handover.py: using LAC 34540 14:21:28.610153 tst handover.py: using RAC 115 14:21:28.738535 tst handover.py: using CellId 34540 14:21:28.865837 tst handover.py: using BVCI 34541 14:21:28.986028 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:21:29.039149 tst handover.py: using LAC 34541 14:21:29.166537 tst handover.py: using RAC 116 14:21:29.288574 tst handover.py: using CellId 34541 14:21:29.408609 tst handover.py: using BVCI 34542 14:21:29.521681 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:29.532887 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:29.543820 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:29.554708 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:29.565990 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:21:29.577354 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:21:29.698096 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:21:29.819010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:21:30.302359 run create_hlr_db(pid=30899): Launched 14:21:30.440253 bus /sierra_2: Setting Powered False 14:21:31.507966 run create_hlr_db(pid=30899): Terminated: ok {rc=0} 14:21:31.927841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30901): Launched 14:21:32.258745 run osmo-hlr_10.42.42.2(pid=30902): Launched 14:21:32.388581 run osmo-stp_10.42.42.5: Starting osmo-stp 14:21:32.930742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30904): Launched 14:21:33.262198 run osmo-stp_10.42.42.5(pid=30905): Launched 14:21:33.390159 run osmo-msc_10.42.42.6: Starting osmo-msc 14:21:33.959813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30907): Launched 14:21:34.292466 run osmo-msc_10.42.42.6(pid=30908): Launched 14:21:34.478159 run osmo-stp_10.42.42.5(pid=30905): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30905)] 14:21:34.617770 run osmo-stp_10.42.42.5(pid=30905): stdout: | (launched: 2022-12-13_14:21:33.201673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:34.757691 run osmo-stp_10.42.42.5(pid=30905): stderr: | 20221213142133391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142133391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142133392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142133392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142133393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142133393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142133393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:34.895262 run osmo-stp_10.42.42.5(pid=30905): stdout: | (launched: 2022-12-13_14:21:33.201673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:35.025863 run osmo-stp_10.42.42.5(pid=30905): stderr: | 20221213142133391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142133391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142133392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142133392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142133393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142133393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142133393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:35.183150 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30905): Process ended prematurely: osmo-stp_10.42.42.5(pid=30905) [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30905)] [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 14:21:35.192194 tst handover.py:18: Test FAILED (6.8 sec) 14:21:35.219895 run osmo-hlr_10.42.42.2(pid=30902): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30902)] 14:21:35.269733 run osmo-hlr_10.42.42.2(pid=30902): stdout: | (launched: 2022-12-13_14:21:32.201431) 14:21:35.321252 run osmo-hlr_10.42.42.2(pid=30902): stderr: | 20221213142132391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142132391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142132391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142132391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142132391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142132391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142132404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142132412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142132413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142132413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:35.393012 run osmo-msc_10.42.42.6(pid=30908): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30908)] 14:21:35.442616 run osmo-msc_10.42.42.6(pid=30908): stdout: | (launched: 2022-12-13_14:21:34.231853) 14:21:35.494379 run osmo-msc_10.42.42.6(pid=30908): stderr: | 20221213142134553 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142134553 DLGLOBAL DEBUG validating counter group 0x7f8f886efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142134553 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142134553 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142134553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142134553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142134555 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142134555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142134556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142134556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:35.546083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30901): Terminating (SIGTERM) 14:21:35.587620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30904): Terminating (SIGTERM) 14:21:35.629179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30907): Terminating (SIGTERM) 14:21:35.671002 --- ParallelTerminationStrategy: PID 30901 died... 14:21:35.690963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30901): Terminated: ok {rc=0} 14:21:35.736869 --- ParallelTerminationStrategy: PID 30904 died... 14:21:35.756391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30904): Terminated: ok {rc=0} 14:21:35.802405 --- ParallelTerminationStrategy: PID 30907 died... 14:21:35.822132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30907): Terminated: ok {rc=0} 14:21:35.909600 bus /sierra_3: Setting Powered False 14:21:37.008943 bus /sierra_3: Setting Powered False 14:21:38.125081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 14:21:39.384893 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:21:39.390543 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:21:39.441694 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:21:39.469229 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:21:39.523374 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:21:39.575700 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:21:39.602740 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:21:40.153559 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 14:21:40.159013 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:40.170366 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:21:40.206382 tst handover.py: using LAC 34542 14:21:40.330047 tst handover.py: using RAC 117 14:21:40.453389 tst handover.py: using CellId 34542 14:21:40.574900 tst handover.py: using BVCI 34543 14:21:40.689288 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:21:40.737393 tst handover.py: using LAC 34543 14:21:40.858651 tst handover.py: using RAC 118 14:21:40.980052 tst handover.py: using CellId 34543 14:21:41.103327 tst handover.py: using BVCI 34544 14:21:41.217695 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:41.228446 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:41.239297 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:41.250257 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:41.261814 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:21:41.273263 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:21:41.395284 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:21:41.513274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:21:41.967451 run create_hlr_db(pid=30913): Launched 14:21:42.086610 bus /sierra_2: Setting Powered False 14:21:43.148409 run create_hlr_db(pid=30913): Terminated: ok {rc=0} 14:21:43.553674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Launched 14:21:43.864456 run osmo-hlr_10.42.42.2(pid=30916): Launched 14:21:43.983097 run osmo-stp_10.42.42.5: Starting osmo-stp 14:21:44.487326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Launched 14:21:44.797547 run osmo-stp_10.42.42.5(pid=30919): Launched 14:21:44.916489 run osmo-msc_10.42.42.6: Starting osmo-msc 14:21:45.452476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30921): Launched 14:21:45.762772 run osmo-msc_10.42.42.6(pid=30922): Launched 14:21:45.972507 run osmo-stp_10.42.42.5(pid=30919): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30919)] 14:21:46.248665 run osmo-stp_10.42.42.5(pid=30919): stdout: | (launched: 2022-12-13_14:21:44.739951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:46.527787 run osmo-stp_10.42.42.5(pid=30919): stderr: | 20221213142144908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142144909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142144909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142144909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142144910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142144910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142144910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:46.685535 run osmo-stp_10.42.42.5(pid=30919): stdout: | (launched: 2022-12-13_14:21:44.739951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:46.815616 run osmo-stp_10.42.42.5(pid=30919): stderr: | 20221213142144908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142144909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142144909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142144909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142144910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142144910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142144910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:46.967379 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30919): Process ended prematurely: osmo-stp_10.42.42.5(pid=30919) [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30919)] [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 14:21:46.976884 tst handover.py:18: Test FAILED (6.8 sec) 14:21:47.004579 run osmo-hlr_10.42.42.2(pid=30916): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30916)] 14:21:47.056939 run osmo-hlr_10.42.42.2(pid=30916): stdout: | (launched: 2022-12-13_14:21:43.807530) 14:21:47.108576 run osmo-hlr_10.42.42.2(pid=30916): stderr: | 20221213142143980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142143980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142143980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142143980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142143980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142143980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142143992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142144000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142144000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142144000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:47.180392 run osmo-msc_10.42.42.6(pid=30922): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30922)] 14:21:47.229372 run osmo-msc_10.42.42.6(pid=30922): stdout: | (launched: 2022-12-13_14:21:45.705567) 14:21:47.281476 run osmo-msc_10.42.42.6(pid=30922): stderr: | 20221213142146132 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142146132 DLGLOBAL DEBUG validating counter group 0x7f1e69c5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142146132 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142146132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142146132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142146133 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142146136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142146137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142146137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142146137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:47.333630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Terminating (SIGTERM) 14:21:47.374093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Terminating (SIGTERM) 14:21:47.414901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30921): Terminating (SIGTERM) 14:21:47.455200 --- ParallelTerminationStrategy: PID 30915 died... 14:21:47.474983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30915): Terminated: ok {rc=0} 14:21:47.519508 --- ParallelTerminationStrategy: PID 30918 died... 14:21:47.538555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30918): Terminated: ok {rc=0} 14:21:47.583074 --- ParallelTerminationStrategy: PID 30921 died... 14:21:47.602329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30921): Terminated: ok {rc=0} 14:21:47.687477 bus /sierra_3: Setting Powered False 14:21:48.786137 bus /sierra_3: Setting Powered False 14:21:49.902087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 14:21:51.153794 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:21:51.158908 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:21:51.208864 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:21:51.235358 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:21:51.286782 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:21:51.336684 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:21:51.363554 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:21:51.917009 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 14:21:51.923436 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:51.934779 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:21:51.969409 tst handover.py: using LAC 34544 14:21:52.099643 tst handover.py: using RAC 119 14:21:52.228634 tst handover.py: using CellId 34544 14:21:52.357534 tst handover.py: using BVCI 34545 14:21:52.477468 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:21:52.527449 tst handover.py: using LAC 34545 14:21:52.656407 tst handover.py: using RAC 120 14:21:52.785732 tst handover.py: using CellId 34545 14:21:52.915651 tst handover.py: using BVCI 34546 14:21:53.029707 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:53.040625 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:53.051395 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:53.062672 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:53.073962 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:21:53.084766 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:21:53.207411 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:21:53.325672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:21:53.778732 run create_hlr_db(pid=30927): Launched 14:21:53.898012 bus /sierra_2: Setting Powered False 14:21:54.958871 run create_hlr_db(pid=30927): Terminated: ok {rc=0} 14:21:55.363621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30929): Launched 14:21:55.675994 run osmo-hlr_10.42.42.2(pid=30930): Launched 14:21:55.793947 run osmo-stp_10.42.42.5: Starting osmo-stp 14:21:56.311619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30932): Launched 14:21:56.625028 run osmo-stp_10.42.42.5(pid=30933): Launched 14:21:56.742951 run osmo-msc_10.42.42.6: Starting osmo-msc 14:21:57.278174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30935): Launched 14:21:57.589941 run osmo-msc_10.42.42.6(pid=30936): Launched 14:21:57.763964 run osmo-stp_10.42.42.5(pid=30933): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30933)] 14:21:57.895539 run osmo-stp_10.42.42.5(pid=30933): stdout: | (launched: 2022-12-13_14:21:56.568093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:58.026707 run osmo-stp_10.42.42.5(pid=30933): stderr: | 20221213142156737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142156737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142156737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142156738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142156738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142156738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142156738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:58.155979 run osmo-stp_10.42.42.5(pid=30933): stdout: | (launched: 2022-12-13_14:21:56.568093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:21:58.279154 run osmo-stp_10.42.42.5(pid=30933): stderr: | 20221213142156737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142156737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142156737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142156738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142156738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142156738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142156738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:21:58.426658 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30933): Process ended prematurely: osmo-stp_10.42.42.5(pid=30933) [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30933)] [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 14:21:58.435278 tst handover.py:18: Test FAILED (6.5 sec) 14:21:58.461559 run osmo-hlr_10.42.42.2(pid=30930): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30930)] 14:21:58.509955 run osmo-hlr_10.42.42.2(pid=30930): stdout: | (launched: 2022-12-13_14:21:55.618903) 14:21:58.559507 run osmo-hlr_10.42.42.2(pid=30930): stderr: | 20221213142155795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142155795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142155795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142155795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142155795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142155795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142155807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142155815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142155815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142155815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:21:58.628835 run osmo-msc_10.42.42.6(pid=30936): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30936)] 14:21:58.676406 run osmo-msc_10.42.42.6(pid=30936): stdout: | (launched: 2022-12-13_14:21:57.532721) 14:21:58.725911 run osmo-msc_10.42.42.6(pid=30936): stderr: | 20221213142157801 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142157801 DLGLOBAL DEBUG validating counter group 0x7f3e14b58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142157801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142157801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142157801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142157801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142157803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142157803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142157804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142157804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:21:58.775691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30929): Terminating (SIGTERM) 14:21:58.815846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30932): Terminating (SIGTERM) 14:21:58.856102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30935): Terminating (SIGTERM) 14:21:58.897234 --- ParallelTerminationStrategy: PID 30929 died... 14:21:58.916671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30929): Terminated: ok {rc=0} 14:21:58.961111 --- ParallelTerminationStrategy: PID 30932 died... 14:21:58.980136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30932): Terminated: ok {rc=0} 14:21:59.024302 --- ParallelTerminationStrategy: PID 30935 died... 14:21:59.043541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30935): Terminated: ok {rc=0} 14:21:59.130195 bus /sierra_3: Setting Powered False 14:22:00.229159 bus /sierra_3: Setting Powered False 14:22:01.353709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:22:02.620337 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:02.625741 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:22:02.673754 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:22:02.701150 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:22:02.762226 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:22:02.807826 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:22:02.834136 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:22:03.388249 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:22:03.395912 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:03.408899 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:22:03.447722 tst handover.py: using LAC 34546 14:22:03.582568 tst handover.py: using RAC 121 14:22:03.712551 tst handover.py: using CellId 34546 14:22:03.841817 tst handover.py: using BVCI 34547 14:22:03.962670 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:22:04.011091 tst handover.py: using LAC 34547 14:22:04.139417 tst handover.py: using RAC 122 14:22:04.267854 tst handover.py: using CellId 34547 14:22:04.390480 tst handover.py: using BVCI 34548 14:22:04.506394 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:04.517786 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:04.528936 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:04.540177 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:04.551806 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:22:04.563311 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:22:04.685264 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:22:04.803634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:22:05.258240 run create_hlr_db(pid=30941): Launched 14:22:05.379123 bus /sierra_2: Setting Powered False 14:22:06.440739 run create_hlr_db(pid=30941): Terminated: ok {rc=0} 14:22:06.866806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Launched 14:22:07.199599 run osmo-hlr_10.42.42.2(pid=30944): Launched 14:22:07.326336 run osmo-stp_10.42.42.5: Starting osmo-stp 14:22:07.870244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Launched 14:22:08.201881 run osmo-stp_10.42.42.5(pid=30947): Launched 14:22:08.329433 run osmo-msc_10.42.42.6: Starting osmo-msc 14:22:08.899382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30949): Launched 14:22:09.232896 run osmo-msc_10.42.42.6(pid=30950): Launched 14:22:09.417758 run osmo-stp_10.42.42.5(pid=30947): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] 14:22:09.556739 run osmo-stp_10.42.42.5(pid=30947): stdout: | (launched: 2022-12-13_14:22:08.140895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:09.696403 run osmo-stp_10.42.42.5(pid=30947): stderr: | 20221213142208329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142208329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142208329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142208330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142208330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142208330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142208330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:09.834460 run osmo-stp_10.42.42.5(pid=30947): stdout: | (launched: 2022-12-13_14:22:08.140895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:09.965648 run osmo-stp_10.42.42.5(pid=30947): stderr: | 20221213142208329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142208329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142208329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142208330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142208330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142208330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142208330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:10.122905 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30947): Process ended prematurely: osmo-stp_10.42.42.5(pid=30947) [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 14:22:10.131754 tst handover.py:18: Test FAILED (6.7 sec) 14:22:10.159169 run osmo-hlr_10.42.42.2(pid=30944): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30944)] 14:22:10.208912 run osmo-hlr_10.42.42.2(pid=30944): stdout: | (launched: 2022-12-13_14:22:07.138916) 14:22:10.260321 run osmo-hlr_10.42.42.2(pid=30944): stderr: | 20221213142207333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142207333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142207333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142207333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142207333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142207333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142207345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142207354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142207355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142207355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:22:10.332200 run osmo-msc_10.42.42.6(pid=30950): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30950)] 14:22:10.381685 run osmo-msc_10.42.42.6(pid=30950): stdout: | (launched: 2022-12-13_14:22:09.172076) 14:22:10.432879 run osmo-msc_10.42.42.6(pid=30950): stderr: | 20221213142209491 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142209491 DLGLOBAL DEBUG validating counter group 0x7f0666ed4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142209491 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142209491 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142209491 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142209492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142209493 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142209494 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142209494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142209494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:22:10.484570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Terminating (SIGTERM) 14:22:10.526903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Terminating (SIGTERM) 14:22:10.568693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30949): Terminating (SIGTERM) 14:22:10.611009 --- ParallelTerminationStrategy: PID 30943 died... 14:22:10.631009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Terminated: ok {rc=0} 14:22:10.676812 --- ParallelTerminationStrategy: PID 30946 died... 14:22:10.696215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Terminated: ok {rc=0} 14:22:10.742050 --- ParallelTerminationStrategy: PID 30949 died... 14:22:10.761560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30949): Terminated: ok {rc=0} 14:22:10.849401 bus /sierra_3: Setting Powered False 14:22:11.948627 bus /sierra_3: Setting Powered False 14:22:13.066223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:22:14.316739 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:14.322104 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:22:14.371602 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:22:14.397785 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:22:14.448359 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:22:14.498011 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:22:14.524769 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:22:15.077431 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:22:15.082914 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:15.094047 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:22:15.128178 tst handover.py: using LAC 34548 14:22:15.258289 tst handover.py: using RAC 123 14:22:15.388771 tst handover.py: using CellId 34548 14:22:15.520091 tst handover.py: using BVCI 34549 14:22:15.642114 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:22:15.692827 tst handover.py: using LAC 34549 14:22:15.825395 tst handover.py: using RAC 124 14:22:15.971239 tst handover.py: using CellId 34549 14:22:16.111824 tst handover.py: using BVCI 34550 14:22:16.266086 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:16.279200 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:16.295326 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:16.311719 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:16.328127 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:22:16.345038 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:22:16.483693 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:22:16.632675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:22:17.141074 run create_hlr_db(pid=30955): Launched 14:22:17.305460 bus /sierra_2: Setting Powered False 14:22:18.370937 run create_hlr_db(pid=30955): Terminated: ok {rc=0} 14:22:18.804125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Launched 14:22:19.136183 run osmo-hlr_10.42.42.2(pid=30958): Launched 14:22:19.261712 run osmo-stp_10.42.42.5: Starting osmo-stp 14:22:19.808440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Launched 14:22:20.140354 run osmo-stp_10.42.42.5(pid=30961): Launched 14:22:20.268121 run osmo-msc_10.42.42.6: Starting osmo-msc 14:22:20.839668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30963): Launched 14:22:21.173694 run osmo-msc_10.42.42.6(pid=30964): Launched 14:22:21.359273 run osmo-stp_10.42.42.5(pid=30961): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] 14:22:21.498672 run osmo-stp_10.42.42.5(pid=30961): stdout: | (launched: 2022-12-13_14:22:20.079472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:21.639759 run osmo-stp_10.42.42.5(pid=30961): stderr: | 20221213142220269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142220269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142220269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142220270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142220270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142220270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142220270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:21.777920 run osmo-stp_10.42.42.5(pid=30961): stdout: | (launched: 2022-12-13_14:22:20.079472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:21.909643 run osmo-stp_10.42.42.5(pid=30961): stderr: | 20221213142220269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142220269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142220269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142220270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142220270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142220270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142220270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:22.067396 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30961): Process ended prematurely: osmo-stp_10.42.42.5(pid=30961) [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 14:22:22.076360 tst handover.py:18: Test FAILED (7.0 sec) 14:22:22.104289 run osmo-hlr_10.42.42.2(pid=30958): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30958)] 14:22:22.154797 run osmo-hlr_10.42.42.2(pid=30958): stdout: | (launched: 2022-12-13_14:22:19.075759) 14:22:22.207537 run osmo-hlr_10.42.42.2(pid=30958): stderr: | 20221213142219270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142219270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142219270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142219270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142219270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142219270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142219282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142219292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142219292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142219292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:22:22.280824 run osmo-msc_10.42.42.6(pid=30964): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30964)] 14:22:22.331460 run osmo-msc_10.42.42.6(pid=30964): stdout: | (launched: 2022-12-13_14:22:21.112767) 14:22:22.383598 run osmo-msc_10.42.42.6(pid=30964): stderr: | 20221213142221433 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142221433 DLGLOBAL DEBUG validating counter group 0x7f1cf2272c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142221433 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142221433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142221433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142221433 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142221435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142221435 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142221436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142221436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:22:22.436077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Terminating (SIGTERM) 14:22:22.478326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Terminating (SIGTERM) 14:22:22.520891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30963): Terminating (SIGTERM) 14:22:22.563569 --- ParallelTerminationStrategy: PID 30957 died... 14:22:22.584057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Terminated: ok {rc=0} 14:22:22.630704 --- ParallelTerminationStrategy: PID 30960 died... 14:22:22.650334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Terminated: ok {rc=0} 14:22:22.696467 --- ParallelTerminationStrategy: PID 30963 died... 14:22:22.716241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30963): Terminated: ok {rc=0} 14:22:22.805217 bus /sierra_3: Setting Powered False 14:22:23.904446 bus /sierra_3: Setting Powered False 14:22:25.019959 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 14:22:26.280202 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:26.285355 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:22:26.322325 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:22:26.349004 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:22:26.403071 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:22:26.440662 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:22:26.468142 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:22:27.017368 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 14:22:27.022903 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:27.034199 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:22:27.071519 tst handover.py: using LAC 34550 14:22:27.195068 tst handover.py: using RAC 125 14:22:27.317257 tst handover.py: using CellId 34550 14:22:27.437357 tst handover.py: using BVCI 34551 14:22:27.549925 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:22:27.587046 tst handover.py: using LAC 34551 14:22:27.708248 tst handover.py: using RAC 126 14:22:27.828606 tst handover.py: using CellId 34551 14:22:27.948921 tst handover.py: using BVCI 34552 14:22:28.061598 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:28.072300 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:28.082956 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:28.093651 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:28.104556 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:22:28.115601 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:22:28.238415 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:22:28.356557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:22:28.810360 run create_hlr_db(pid=30969): Launched 14:22:28.931140 bus /sierra_2: Setting Powered False 14:22:29.992343 run create_hlr_db(pid=30969): Terminated: ok {rc=0} 14:22:30.397390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30971): Launched 14:22:30.710350 run osmo-hlr_10.42.42.2(pid=30972): Launched 14:22:30.833600 run osmo-stp_10.42.42.5: Starting osmo-stp 14:22:31.482660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30974): Launched 14:22:31.838425 run osmo-stp_10.42.42.5(pid=30975): Launched 14:22:32.040208 run osmo-msc_10.42.42.6: Starting osmo-msc 14:22:32.624215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30977): Launched 14:22:32.935320 run osmo-msc_10.42.42.6(pid=30978): Launched 14:22:33.108024 run osmo-stp_10.42.42.5(pid=30975): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30975)] 14:22:33.237938 run osmo-stp_10.42.42.5(pid=30975): stdout: | (launched: 2022-12-13_14:22:31.775921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:33.368043 run osmo-stp_10.42.42.5(pid=30975): stderr: | 20221213142232046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142232046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142232046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142232047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142232047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142232047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142232047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:33.496691 run osmo-stp_10.42.42.5(pid=30975): stdout: | (launched: 2022-12-13_14:22:31.775921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:33.619731 run osmo-stp_10.42.42.5(pid=30975): stderr: | 20221213142232046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142232046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142232046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142232047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142232047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142232047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142232047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:33.766472 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30975): Process ended prematurely: osmo-stp_10.42.42.5(pid=30975) [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30975)] [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 14:22:33.774846 tst handover.py:18: Test FAILED (6.7 sec) 14:22:33.800914 run osmo-hlr_10.42.42.2(pid=30972): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30972)] 14:22:33.849357 run osmo-hlr_10.42.42.2(pid=30972): stdout: | (launched: 2022-12-13_14:22:30.652703) 14:22:33.898955 run osmo-hlr_10.42.42.2(pid=30972): stderr: | 20221213142230828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142230828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142230828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142230828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142230828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142230828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142230851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142230859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142230859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142230859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:22:33.968515 run osmo-msc_10.42.42.6(pid=30978): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30978)] 14:22:34.015879 run osmo-msc_10.42.42.6(pid=30978): stdout: | (launched: 2022-12-13_14:22:32.878090) 14:22:34.065306 run osmo-msc_10.42.42.6(pid=30978): stderr: | 20221213142233148 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142233148 DLGLOBAL DEBUG validating counter group 0x7fe36e2f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142233149 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142233149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142233149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142233149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142233151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142233151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142233151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142233151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:22:34.114812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30971): Terminating (SIGTERM) 14:22:34.154793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30974): Terminating (SIGTERM) 14:22:34.194685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30977): Terminating (SIGTERM) 14:22:34.234845 --- ParallelTerminationStrategy: PID 30971 died... 14:22:34.254309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30971): Terminated: ok {rc=0} 14:22:34.298421 --- ParallelTerminationStrategy: PID 30974 died... 14:22:34.317169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30974): Terminated: ok {rc=0} 14:22:34.361115 --- ParallelTerminationStrategy: PID 30977 died... 14:22:34.379820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30977): Terminated: ok {rc=0} 14:22:34.465775 bus /sierra_3: Setting Powered False 14:22:35.568883 bus /sierra_3: Setting Powered False 14:22:36.685530 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 14:22:37.928781 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:37.934519 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:22:37.984618 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:22:38.011873 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:22:38.064892 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:22:38.115797 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:22:38.143293 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:22:38.695536 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 14:22:38.701399 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:38.712796 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:22:38.746770 tst handover.py: using LAC 34552 14:22:38.869172 tst handover.py: using RAC 127 14:22:38.999315 tst handover.py: using CellId 34552 14:22:39.125824 tst handover.py: using BVCI 34553 14:22:39.239872 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:22:39.286622 tst handover.py: using LAC 34553 14:22:39.409287 tst handover.py: using RAC 128 14:22:39.531170 tst handover.py: using CellId 34553 14:22:39.653054 tst handover.py: using BVCI 34554 14:22:39.765767 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:39.776537 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:39.787228 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:39.797978 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:39.808940 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:22:39.819937 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:22:39.941305 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:22:40.059392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:22:40.513707 run create_hlr_db(pid=30983): Launched 14:22:40.632757 bus /sierra_2: Setting Powered False 14:22:41.694261 run create_hlr_db(pid=30983): Terminated: ok {rc=0} 14:22:42.118736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Launched 14:22:42.450961 run osmo-hlr_10.42.42.2(pid=30986): Launched 14:22:42.578386 run osmo-stp_10.42.42.5: Starting osmo-stp 14:22:43.120705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Launched 14:22:43.431925 run osmo-stp_10.42.42.5(pid=30989): Launched 14:22:43.550213 run osmo-msc_10.42.42.6: Starting osmo-msc 14:22:44.079468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30991): Launched 14:22:44.389438 run osmo-msc_10.42.42.6(pid=30992): Launched 14:22:44.564009 run osmo-stp_10.42.42.5(pid=30989): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] 14:22:44.695394 run osmo-stp_10.42.42.5(pid=30989): stdout: | (launched: 2022-12-13_14:22:43.375233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:44.826711 run osmo-stp_10.42.42.5(pid=30989): stderr: | 20221213142243545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142243545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142243545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142243546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142243546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142243546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142243546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:44.956190 run osmo-stp_10.42.42.5(pid=30989): stdout: | (launched: 2022-12-13_14:22:43.375233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:45.079780 run osmo-stp_10.42.42.5(pid=30989): stderr: | 20221213142243545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142243545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142243545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142243546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142243546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142243546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142243546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:45.228228 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30989): Process ended prematurely: osmo-stp_10.42.42.5(pid=30989) [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 14:22:45.236666 tst handover.py:18: Test FAILED (6.5 sec) 14:22:45.263122 run osmo-hlr_10.42.42.2(pid=30986): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30986)] 14:22:45.311352 run osmo-hlr_10.42.42.2(pid=30986): stdout: | (launched: 2022-12-13_14:22:42.389946) 14:22:45.361130 run osmo-hlr_10.42.42.2(pid=30986): stderr: | 20221213142242585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142242585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142242585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142242585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142242585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142242585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142242598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142242607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142242607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142242607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:22:45.430316 run osmo-msc_10.42.42.6(pid=30992): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30992)] 14:22:45.477646 run osmo-msc_10.42.42.6(pid=30992): stdout: | (launched: 2022-12-13_14:22:44.332162) 14:22:45.527419 run osmo-msc_10.42.42.6(pid=30992): stderr: | 20221213142244604 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142244604 DLGLOBAL DEBUG validating counter group 0x7f7524772c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142244604 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142244604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142244605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142244605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142244606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142244607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142244607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142244607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:22:45.577376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Terminating (SIGTERM) 14:22:45.617218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Terminating (SIGTERM) 14:22:45.657569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30991): Terminating (SIGTERM) 14:22:45.698341 --- ParallelTerminationStrategy: PID 30985 died... 14:22:45.717689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Terminated: ok {rc=0} 14:22:45.761848 --- ParallelTerminationStrategy: PID 30988 died... 14:22:45.780695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Terminated: ok {rc=0} 14:22:45.824878 --- ParallelTerminationStrategy: PID 30991 died... 14:22:45.844541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30991): Terminated: ok {rc=0} 14:22:45.940474 bus /sierra_3: Setting Powered False 14:22:47.045252 bus /sierra_3: Setting Powered False 14:22:48.161060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 14:22:49.421231 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:49.427433 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:22:49.477690 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:22:49.504932 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:22:49.557233 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:22:49.607833 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:22:49.635293 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:22:50.185036 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 14:22:50.190483 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:50.201588 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:22:50.234590 tst handover.py: using LAC 34554 14:22:50.356312 tst handover.py: using RAC 129 14:22:50.477385 tst handover.py: using CellId 34554 14:22:50.599357 tst handover.py: using BVCI 34555 14:22:50.713707 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:22:50.759877 tst handover.py: using LAC 34555 14:22:50.881049 tst handover.py: using RAC 130 14:22:51.001401 tst handover.py: using CellId 34555 14:22:51.121241 tst handover.py: using BVCI 34556 14:22:51.233578 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:51.244500 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:51.255431 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:51.266285 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:51.277757 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:22:51.289050 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:22:51.407443 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:22:51.526954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:22:51.981846 run create_hlr_db(pid=30997): Launched 14:22:52.101910 bus /sierra_2: Setting Powered False 14:22:53.163262 run create_hlr_db(pid=30997): Terminated: ok {rc=0} 14:22:53.591470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Launched 14:22:53.925284 run osmo-hlr_10.42.42.2(pid=31000): Launched 14:22:54.052325 run osmo-stp_10.42.42.5: Starting osmo-stp 14:22:54.594343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Launched 14:22:54.927449 run osmo-stp_10.42.42.5(pid=31003): Launched 14:22:55.056260 run osmo-msc_10.42.42.6: Starting osmo-msc 14:22:55.627017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31005): Launched 14:22:55.960094 run osmo-msc_10.42.42.6(pid=31006): Launched 14:22:56.145739 run osmo-stp_10.42.42.5(pid=31003): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31003)] 14:22:56.284699 run osmo-stp_10.42.42.5(pid=31003): stdout: | (launched: 2022-12-13_14:22:54.865557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:56.424765 run osmo-stp_10.42.42.5(pid=31003): stderr: | 20221213142255054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142255054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142255054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142255054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142255055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142255055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142255055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:56.563728 run osmo-stp_10.42.42.5(pid=31003): stdout: | (launched: 2022-12-13_14:22:54.865557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:22:56.695547 run osmo-stp_10.42.42.5(pid=31003): stderr: | 20221213142255054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142255054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142255054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142255054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142255055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142255055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142255055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:22:56.854085 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31003): Process ended prematurely: osmo-stp_10.42.42.5(pid=31003) [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31003)] [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 14:22:56.863324 tst handover.py:18: Test FAILED (6.7 sec) 14:22:56.891030 run osmo-hlr_10.42.42.2(pid=31000): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31000)] 14:22:56.940671 run osmo-hlr_10.42.42.2(pid=31000): stdout: | (launched: 2022-12-13_14:22:53.862962) 14:22:56.992073 run osmo-hlr_10.42.42.2(pid=31000): stderr: | 20221213142254058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142254058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142254058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142254058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142254058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142254058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142254070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142254079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142254079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142254079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:22:57.063887 run osmo-msc_10.42.42.6(pid=31006): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31006)] 14:22:57.113879 run osmo-msc_10.42.42.6(pid=31006): stdout: | (launched: 2022-12-13_14:22:55.899428) 14:22:57.165225 run osmo-msc_10.42.42.6(pid=31006): stderr: | 20221213142256219 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142256219 DLGLOBAL DEBUG validating counter group 0x7f5ffb948c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142256219 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142256219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142256219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142256219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142256221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142256222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142256222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142256222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:22:57.216680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Terminating (SIGTERM) 14:22:57.258290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Terminating (SIGTERM) 14:22:57.300036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31005): Terminating (SIGTERM) 14:22:57.342611 --- ParallelTerminationStrategy: PID 30999 died... 14:22:57.362485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30999): Terminated: ok {rc=0} 14:22:57.408880 --- ParallelTerminationStrategy: PID 31002 died... 14:22:57.428522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31002): Terminated: ok {rc=0} 14:22:57.474797 --- ParallelTerminationStrategy: PID 31005 died... 14:22:57.494509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31005): Terminated: ok {rc=0} 14:22:57.584049 bus /sierra_3: Setting Powered False 14:22:58.684591 bus /sierra_3: Setting Powered False 14:22:59.802340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:23:01.081035 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:01.087438 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:23:01.151892 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:23:01.179698 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:23:01.234722 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:23:01.309648 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:23:01.342130 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:23:01.885020 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:23:01.893705 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:01.909871 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:23:01.976524 tst handover.py: using LAC 34556 14:23:02.142673 tst handover.py: using RAC 131 14:23:02.287782 tst handover.py: using CellId 34556 14:23:02.415166 tst handover.py: using BVCI 34557 14:23:02.535630 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:23:02.579678 tst handover.py: using LAC 34557 14:23:02.709479 tst handover.py: using RAC 132 14:23:02.838580 tst handover.py: using CellId 34557 14:23:02.966800 tst handover.py: using BVCI 34558 14:23:03.086491 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:03.098205 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:03.109805 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:03.121327 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:03.133116 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:23:03.144552 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:23:03.262503 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:23:03.379646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:03.834965 run create_hlr_db(pid=31011): Launched 14:23:03.956038 bus /sierra_2: Setting Powered False 14:23:05.017759 run create_hlr_db(pid=31011): Terminated: ok {rc=0} 14:23:05.423569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31013): Launched 14:23:05.734956 run osmo-hlr_10.42.42.2(pid=31014): Launched 14:23:05.853800 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:06.359182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31016): Launched 14:23:06.669959 run osmo-stp_10.42.42.5(pid=31017): Launched 14:23:06.788489 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:07.323142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31019): Launched 14:23:07.636082 run osmo-msc_10.42.42.6(pid=31020): Launched 14:23:07.810215 run osmo-stp_10.42.42.5(pid=31017): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31017)] 14:23:07.940837 run osmo-stp_10.42.42.5(pid=31017): stdout: | (launched: 2022-12-13_14:23:06.613066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:08.071829 run osmo-stp_10.42.42.5(pid=31017): stderr: | 20221213142306781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142306781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142306782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142306782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142306783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142306783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142306783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:08.201371 run osmo-stp_10.42.42.5(pid=31017): stdout: | (launched: 2022-12-13_14:23:06.613066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:08.324037 run osmo-stp_10.42.42.5(pid=31017): stderr: | 20221213142306781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142306781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142306782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142306782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142306783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142306783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142306783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:08.471881 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31017): Process ended prematurely: osmo-stp_10.42.42.5(pid=31017) [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31017)] [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 14:23:08.480896 tst handover.py:18: Test FAILED (6.6 sec) 14:23:08.507401 run osmo-hlr_10.42.42.2(pid=31014): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31014)] 14:23:08.556338 run osmo-hlr_10.42.42.2(pid=31014): stdout: | (launched: 2022-12-13_14:23:05.677458) 14:23:08.606103 run osmo-hlr_10.42.42.2(pid=31014): stderr: | 20221213142305851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142305851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142305851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142305851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142305851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142305851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142305863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142305871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142305871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142305872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:08.675547 run osmo-msc_10.42.42.6(pid=31020): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31020)] 14:23:08.723174 run osmo-msc_10.42.42.6(pid=31020): stdout: | (launched: 2022-12-13_14:23:07.579033) 14:23:08.772480 run osmo-msc_10.42.42.6(pid=31020): stderr: | 20221213142307851 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142307851 DLGLOBAL DEBUG validating counter group 0x7fc10f8cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142307851 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142307851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142307851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142307851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142307853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142307853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142307854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142307854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:08.822366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31013): Terminating (SIGTERM) 14:23:08.862755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31016): Terminating (SIGTERM) 14:23:08.903032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31019): Terminating (SIGTERM) 14:23:08.944262 --- ParallelTerminationStrategy: PID 31013 died... 14:23:08.963715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31013): Terminated: ok {rc=0} 14:23:09.008424 --- ParallelTerminationStrategy: PID 31016 died... 14:23:09.027518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31016): Terminated: ok {rc=0} 14:23:09.071865 --- ParallelTerminationStrategy: PID 31019 died... 14:23:09.090995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31019): Terminated: ok {rc=0} 14:23:09.176439 bus /sierra_3: Setting Powered False 14:23:10.275563 bus /sierra_3: Setting Powered False 14:23:11.394387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:23:12.660041 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:12.666718 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:23:12.731762 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:23:12.759378 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:23:12.813508 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:23:12.877470 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:23:12.903992 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:23:13.454429 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:23:13.459825 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:13.470981 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:23:13.521277 tst handover.py: using LAC 34558 14:23:13.653352 tst handover.py: using RAC 133 14:23:13.783700 tst handover.py: using CellId 34558 14:23:13.912578 tst handover.py: using BVCI 34559 14:23:14.033700 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:23:14.084320 tst handover.py: using LAC 34559 14:23:14.215960 tst handover.py: using RAC 134 14:23:14.346712 tst handover.py: using CellId 34559 14:23:14.476699 tst handover.py: using BVCI 34560 14:23:14.597755 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:14.609290 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:14.620563 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:14.631984 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:14.643314 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:23:14.654704 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:23:14.772331 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:23:14.895012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:15.380133 run create_hlr_db(pid=31025): Launched 14:23:15.514163 bus /sierra_2: Setting Powered False 14:23:16.575028 run create_hlr_db(pid=31025): Terminated: ok {rc=0} 14:23:17.033449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Launched 14:23:17.372127 run osmo-hlr_10.42.42.2(pid=31028): Launched 14:23:17.491522 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:17.998153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Launched 14:23:18.310252 run osmo-stp_10.42.42.5(pid=31031): Launched 14:23:18.430959 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:18.963563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Launched 14:23:19.275835 run osmo-msc_10.42.42.6(pid=31034): Launched 14:23:19.449338 run osmo-stp_10.42.42.5(pid=31031): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] 14:23:19.580906 run osmo-stp_10.42.42.5(pid=31031): stdout: | (launched: 2022-12-13_14:23:18.253303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:19.712161 run osmo-stp_10.42.42.5(pid=31031): stderr: | 20221213142318422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142318422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142318422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142318423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142318423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142318423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142318423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:19.841784 run osmo-stp_10.42.42.5(pid=31031): stdout: | (launched: 2022-12-13_14:23:18.253303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:19.964666 run osmo-stp_10.42.42.5(pid=31031): stderr: | 20221213142318422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142318422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142318422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142318423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142318423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142318423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142318423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:20.112200 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31031): Process ended prematurely: osmo-stp_10.42.42.5(pid=31031) [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 14:23:20.120542 tst handover.py:18: Test FAILED (6.7 sec) 14:23:20.147425 run osmo-hlr_10.42.42.2(pid=31028): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31028)] 14:23:20.195573 run osmo-hlr_10.42.42.2(pid=31028): stdout: | (launched: 2022-12-13_14:23:17.313908) 14:23:20.244744 run osmo-hlr_10.42.42.2(pid=31028): stderr: | 20221213142317489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142317489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142317489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142317489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142317489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142317489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142317501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142317510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142317510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142317510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:20.313779 run osmo-msc_10.42.42.6(pid=31034): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31034)] 14:23:20.361068 run osmo-msc_10.42.42.6(pid=31034): stdout: | (launched: 2022-12-13_14:23:19.218192) 14:23:20.410410 run osmo-msc_10.42.42.6(pid=31034): stderr: | 20221213142319487 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142319487 DLGLOBAL DEBUG validating counter group 0x7f2181b3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142319487 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142319487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142319487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142319487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142319489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142319489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142319490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142319490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:20.460062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Terminating (SIGTERM) 14:23:20.499945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Terminating (SIGTERM) 14:23:20.539761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Terminating (SIGTERM) 14:23:20.579842 --- ParallelTerminationStrategy: PID 31027 died... 14:23:20.599338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Terminated: ok {rc=0} 14:23:20.643617 --- ParallelTerminationStrategy: PID 31030 died... 14:23:20.662644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Terminated: ok {rc=0} 14:23:20.706797 --- ParallelTerminationStrategy: PID 31033 died... 14:23:20.725842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Terminated: ok {rc=0} 14:23:20.812226 bus /sierra_3: Setting Powered False 14:23:21.911540 bus /sierra_3: Setting Powered False 14:23:23.029737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 14:23:24.308667 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:24.314517 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:23:24.366412 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:23:24.393832 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:23:24.448616 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:23:24.501205 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:23:24.528785 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:23:25.078719 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 14:23:25.084530 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:25.095902 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:23:25.145263 tst handover.py: using LAC 34560 14:23:25.275297 tst handover.py: using RAC 135 14:23:25.406109 tst handover.py: using CellId 34560 14:23:25.535564 tst handover.py: using BVCI 34561 14:23:25.655449 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:23:25.691627 tst handover.py: using LAC 34561 14:23:25.814799 tst handover.py: using RAC 136 14:23:25.937580 tst handover.py: using CellId 34561 14:23:26.067449 tst handover.py: using BVCI 34562 14:23:26.189808 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.201295 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.212355 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.223694 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.235317 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.246455 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:23:26.363667 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:23:26.484191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:26.969104 run create_hlr_db(pid=31039): Launched 14:23:27.104276 bus /sierra_2: Setting Powered False 14:23:28.169566 run create_hlr_db(pid=31039): Terminated: ok {rc=0} 14:23:28.585668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Launched 14:23:28.899051 run osmo-hlr_10.42.42.2(pid=31042): Launched 14:23:29.018091 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:29.539829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Launched 14:23:29.850961 run osmo-stp_10.42.42.5(pid=31045): Launched 14:23:29.970023 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:30.504189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31047): Launched 14:23:30.815769 run osmo-msc_10.42.42.6(pid=31048): Launched 14:23:31.100136 run osmo-stp_10.42.42.5(pid=31045): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31045)] 14:23:31.410619 run osmo-stp_10.42.42.5(pid=31045): stdout: | (launched: 2022-12-13_14:23:29.793931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:31.542357 run osmo-stp_10.42.42.5(pid=31045): stderr: | 20221213142329961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142329961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142329962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142329962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142329962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142329963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142329963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:31.686293 run osmo-stp_10.42.42.5(pid=31045): stdout: | (launched: 2022-12-13_14:23:29.793931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:31.824493 run osmo-stp_10.42.42.5(pid=31045): stderr: | 20221213142329961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142329961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142329962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142329962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142329962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142329963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142329963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:31.988749 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31045): Process ended prematurely: osmo-stp_10.42.42.5(pid=31045) [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31045)] [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 14:23:31.999066 tst handover.py:18: Test FAILED (6.9 sec) 14:23:32.028144 run osmo-hlr_10.42.42.2(pid=31042): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31042)] 14:23:32.083225 run osmo-hlr_10.42.42.2(pid=31042): stdout: | (launched: 2022-12-13_14:23:28.840899) 14:23:32.138428 run osmo-hlr_10.42.42.2(pid=31042): stderr: | 20221213142329015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142329015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142329015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142329015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142329015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142329015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142329027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142329035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142329035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142329036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:32.213781 run osmo-msc_10.42.42.6(pid=31048): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31048)] 14:23:32.266202 run osmo-msc_10.42.42.6(pid=31048): stdout: | (launched: 2022-12-13_14:23:30.758508) 14:23:32.320347 run osmo-msc_10.42.42.6(pid=31048): stderr: | 20221213142331170 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142331170 DLGLOBAL DEBUG validating counter group 0x7fc6639b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142331170 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142331170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142331170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142331171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142331172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142331173 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142331173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142331173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:32.375899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Terminating (SIGTERM) 14:23:32.418105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Terminating (SIGTERM) 14:23:32.460757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31047): Terminating (SIGTERM) 14:23:32.503546 --- ParallelTerminationStrategy: PID 31041 died... 14:23:32.524665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31041): Terminated: ok {rc=0} 14:23:32.572318 --- ParallelTerminationStrategy: PID 31044 died... 14:23:32.592874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31044): Terminated: ok {rc=0} 14:23:32.639915 --- ParallelTerminationStrategy: PID 31047 died... 14:23:32.660273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31047): Terminated: ok {rc=0} 14:23:32.750561 bus /sierra_3: Setting Powered False 14:23:33.849900 bus /sierra_3: Setting Powered False 14:23:34.967112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 14:23:36.226275 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:36.232706 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:23:36.296095 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:23:36.322787 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:23:36.375514 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:23:36.440125 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:23:36.466757 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:23:37.019973 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 14:23:37.026438 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:37.038028 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:23:37.085310 tst handover.py: using LAC 34562 14:23:37.206409 tst handover.py: using RAC 137 14:23:37.327172 tst handover.py: using CellId 34562 14:23:37.449860 tst handover.py: using BVCI 34563 14:23:37.575686 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:23:37.625526 tst handover.py: using LAC 34563 14:23:37.755985 tst handover.py: using RAC 138 14:23:37.896154 tst handover.py: using CellId 34563 14:23:38.034359 tst handover.py: using BVCI 34564 14:23:38.154765 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:38.166431 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:38.178087 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:38.189331 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:38.200393 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:23:38.211504 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:23:38.328183 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:23:38.450364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:38.903034 run create_hlr_db(pid=31053): Launched 14:23:39.022545 bus /sierra_2: Setting Powered False 14:23:40.083861 run create_hlr_db(pid=31053): Terminated: ok {rc=0} 14:23:40.490183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Launched 14:23:40.801969 run osmo-hlr_10.42.42.2(pid=31056): Launched 14:23:40.920227 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:41.437733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Launched 14:23:41.750703 run osmo-stp_10.42.42.5(pid=31059): Launched 14:23:41.869217 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:42.406343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Launched 14:23:42.718704 run osmo-msc_10.42.42.6(pid=31062): Launched 14:23:42.893168 run osmo-stp_10.42.42.5(pid=31059): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] 14:23:43.024483 run osmo-stp_10.42.42.5(pid=31059): stdout: | (launched: 2022-12-13_14:23:41.693276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:43.155748 run osmo-stp_10.42.42.5(pid=31059): stderr: | 20221213142341862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142341862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142341862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142341863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142341863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142341863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142341863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:43.285605 run osmo-stp_10.42.42.5(pid=31059): stdout: | (launched: 2022-12-13_14:23:41.693276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:43.408392 run osmo-stp_10.42.42.5(pid=31059): stderr: | 20221213142341862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142341862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142341862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142341863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142341863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142341863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142341863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:43.556216 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31059): Process ended prematurely: osmo-stp_10.42.42.5(pid=31059) [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 14:23:43.564599 tst handover.py:18: Test FAILED (6.5 sec) 14:23:43.590898 run osmo-hlr_10.42.42.2(pid=31056): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31056)] 14:23:43.639402 run osmo-hlr_10.42.42.2(pid=31056): stdout: | (launched: 2022-12-13_14:23:40.744066) 14:23:43.689467 run osmo-hlr_10.42.42.2(pid=31056): stderr: | 20221213142340917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142340918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142340918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142340918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142340918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142340918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142340931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142340941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142340942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142340942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:43.758806 run osmo-msc_10.42.42.6(pid=31062): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31062)] 14:23:43.806161 run osmo-msc_10.42.42.6(pid=31062): stdout: | (launched: 2022-12-13_14:23:42.661465) 14:23:43.855634 run osmo-msc_10.42.42.6(pid=31062): stderr: | 20221213142342930 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142342931 DLGLOBAL DEBUG validating counter group 0x7f2db43e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142342931 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142342931 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142342931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142342931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142342933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142342933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142342934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142342934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:43.905579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Terminating (SIGTERM) 14:23:43.945633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Terminating (SIGTERM) 14:23:43.986379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Terminating (SIGTERM) 14:23:44.026972 --- ParallelTerminationStrategy: PID 31055 died... 14:23:44.046645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Terminated: ok {rc=0} 14:23:44.091422 --- ParallelTerminationStrategy: PID 31058 died... 14:23:44.110647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Terminated: ok {rc=0} 14:23:44.155246 --- ParallelTerminationStrategy: PID 31061 died... 14:23:44.174474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Terminated: ok {rc=0} 14:23:44.258874 bus /sierra_3: Setting Powered False 14:23:45.357914 bus /sierra_3: Setting Powered False 14:23:46.482250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 14:23:47.823809 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:47.831891 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:23:47.903071 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:23:47.933297 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:23:48.026368 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:23:48.140305 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:23:48.170754 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:23:48.701588 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 14:23:48.707882 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:48.723606 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:23:48.779968 tst handover.py: using LAC 34564 14:23:48.935396 tst handover.py: using RAC 139 14:23:49.091306 tst handover.py: using CellId 34564 14:23:49.251137 tst handover.py: using BVCI 34565 14:23:49.405641 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:23:49.459315 tst handover.py: using LAC 34565 14:23:49.594536 tst handover.py: using RAC 140 14:23:49.727557 tst handover.py: using CellId 34565 14:23:49.858430 tst handover.py: using BVCI 34566 14:23:49.982423 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:49.994776 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:50.006959 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:50.019229 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:50.031545 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:23:50.043879 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:23:50.168904 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:23:50.293356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:50.790986 run create_hlr_db(pid=31337): Launched 14:23:50.954448 bus /sierra_2: Setting Powered False 14:23:52.017225 run create_hlr_db(pid=31337): Terminated: ok {rc=0} 14:23:52.433410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31341): Launched 14:23:52.768524 run osmo-hlr_10.42.42.2(pid=31342): Launched 14:23:53.024068 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:53.663719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31344): Launched 14:23:54.009662 run osmo-stp_10.42.42.5(pid=31345): Launched 14:23:54.266641 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:54.916178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31347): Launched 14:23:55.264081 run osmo-msc_10.42.42.6(pid=31348): Launched 14:23:55.634183 run osmo-stp_10.42.42.5(pid=31345): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31345)] 14:23:55.926230 run osmo-stp_10.42.42.5(pid=31345): stdout: | (launched: 2022-12-13_14:23:53.948614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:56.087917 run osmo-stp_10.42.42.5(pid=31345): stderr: | 20221213142354246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142354246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142354246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142354247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142354247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142354247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142354247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:56.228598 run osmo-stp_10.42.42.5(pid=31345): stdout: | (launched: 2022-12-13_14:23:53.948614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:56.362980 run osmo-stp_10.42.42.5(pid=31345): stderr: | 20221213142354246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142354246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142354246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142354247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142354247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142354247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142354247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:56.523977 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31345): Process ended prematurely: osmo-stp_10.42.42.5(pid=31345) [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31345)] [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 14:23:56.534071 tst handover.py:18: Test FAILED (7.8 sec) 14:23:56.563492 run osmo-hlr_10.42.42.2(pid=31342): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31342)] 14:23:56.616018 run osmo-hlr_10.42.42.2(pid=31342): stdout: | (launched: 2022-12-13_14:23:52.709625) 14:23:56.669835 run osmo-hlr_10.42.42.2(pid=31342): stderr: | 20221213142353012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142353012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142353012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142353012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142353012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142353012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142353026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142353039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142353040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142353040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:56.744535 run osmo-msc_10.42.42.6(pid=31348): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31348)] 14:23:56.796668 run osmo-msc_10.42.42.6(pid=31348): stdout: | (launched: 2022-12-13_14:23:55.203024) 14:23:56.850212 run osmo-msc_10.42.42.6(pid=31348): stderr: | 20221213142355709 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142355709 DLGLOBAL DEBUG validating counter group 0x7f25fc882c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142355709 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142355709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142355709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142355710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142355711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142355712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142355712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142355712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:56.904577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31341): Terminating (SIGTERM) 14:23:56.948462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31344): Terminating (SIGTERM) 14:23:56.992864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31347): Terminating (SIGTERM) 14:23:57.039041 --- ParallelTerminationStrategy: PID 31341 died... 14:23:57.060323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31341): Terminated: ok {rc=0} 14:23:57.110129 --- ParallelTerminationStrategy: PID 31344 died... 14:23:57.130886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31344): Terminated: ok {rc=0} 14:23:57.178742 --- ParallelTerminationStrategy: PID 31347 died... 14:23:57.199719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31347): Terminated: ok {rc=0} 14:23:57.291080 bus /sierra_3: Setting Powered False 14:23:58.395860 bus /sierra_3: Setting Powered False 14:23:59.516575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:24:00.803385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:00.810077 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:24:00.897640 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:24:00.939444 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:24:01.018280 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:24:01.102387 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:24:01.142682 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:24:01.731205 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:24:01.742577 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:01.762468 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:24:01.820556 tst handover.py: using LAC 34566 14:24:01.986242 tst handover.py: using RAC 141 14:24:02.152623 tst handover.py: using CellId 34566 14:24:02.306802 tst handover.py: using BVCI 34567 14:24:02.461780 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:24:02.519458 tst handover.py: using LAC 34567 14:24:02.683065 tst handover.py: using RAC 142 14:24:02.844113 tst handover.py: using CellId 34567 14:24:03.000688 tst handover.py: using BVCI 34568 14:24:03.160715 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:03.172912 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:03.185579 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:03.201759 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:03.216819 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:24:03.228914 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:24:03.353706 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:24:03.477076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:03.976802 run create_hlr_db(pid=31353): Launched 14:24:04.149342 bus /sierra_2: Setting Powered False 14:24:05.216655 run create_hlr_db(pid=31353): Terminated: ok {rc=0} 14:24:05.664825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31355): Launched 14:24:06.025323 run osmo-hlr_10.42.42.2(pid=31356): Launched 14:24:06.281563 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:06.939674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31358): Launched 14:24:07.293533 run osmo-stp_10.42.42.5(pid=31359): Launched 14:24:07.551610 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:08.215628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31361): Launched 14:24:08.571733 run osmo-msc_10.42.42.6(pid=31362): Launched 14:24:08.957954 run osmo-stp_10.42.42.5(pid=31359): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31359)] 14:24:09.247380 run osmo-stp_10.42.42.5(pid=31359): stdout: | (launched: 2022-12-13_14:24:07.231584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:09.412632 run osmo-stp_10.42.42.5(pid=31359): stderr: | 20221213142407527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142407527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142407527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142407528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142407528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142407528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142407528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:09.558217 run osmo-stp_10.42.42.5(pid=31359): stdout: | (launched: 2022-12-13_14:24:07.231584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:09.695554 run osmo-stp_10.42.42.5(pid=31359): stderr: | 20221213142407527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142407527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142407527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142407528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142407528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142407528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142407528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:09.860578 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31359): Process ended prematurely: osmo-stp_10.42.42.5(pid=31359) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31359)] [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 14:24:09.871221 tst handover.py:18: Test FAILED (8.1 sec) 14:24:09.900896 run osmo-hlr_10.42.42.2(pid=31356): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31356)] 14:24:09.954223 run osmo-hlr_10.42.42.2(pid=31356): stdout: | (launched: 2022-12-13_14:24:05.957467) 14:24:10.008328 run osmo-hlr_10.42.42.2(pid=31356): stderr: | 20221213142406266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142406266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142406266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142406266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142406266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142406266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142406291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142406304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142406304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142406304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:10.084041 run osmo-msc_10.42.42.6(pid=31362): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31362)] 14:24:10.139353 run osmo-msc_10.42.42.6(pid=31362): stdout: | (launched: 2022-12-13_14:24:08.507402) 14:24:10.193208 run osmo-msc_10.42.42.6(pid=31362): stderr: | 20221213142409008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142409008 DLGLOBAL DEBUG validating counter group 0x7f2ddcec1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142409008 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142409008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142409017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142409017 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142409019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142409019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142409020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142409020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:10.247627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31355): Terminating (SIGTERM) 14:24:10.291666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31358): Terminating (SIGTERM) 14:24:10.339149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31361): Terminating (SIGTERM) 14:24:10.385651 --- ParallelTerminationStrategy: PID 31355 died... 14:24:10.407095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31355): Terminated: ok {rc=0} 14:24:10.456858 --- ParallelTerminationStrategy: PID 31358 died... 14:24:10.477721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31358): Terminated: ok {rc=0} 14:24:10.525540 --- ParallelTerminationStrategy: PID 31361 died... 14:24:10.547225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31361): Terminated: ok {rc=0} 14:24:10.639305 bus /sierra_3: Setting Powered False 14:24:11.742286 bus /sierra_3: Setting Powered False 14:24:12.857901 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 14:24:14.131855 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:14.138263 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:24:14.187088 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:24:14.213838 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:24:14.268411 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:24:14.315309 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:24:14.341759 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:24:14.895558 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 14:24:14.901166 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:14.912608 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:24:14.956896 tst handover.py: using LAC 34568 14:24:15.088512 tst handover.py: using RAC 143 14:24:15.221812 tst handover.py: using CellId 34568 14:24:15.351546 tst handover.py: using BVCI 34569 14:24:15.471815 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:24:15.506535 tst handover.py: using LAC 34569 14:24:15.635646 tst handover.py: using RAC 144 14:24:15.763553 tst handover.py: using CellId 34569 14:24:15.904292 tst handover.py: using BVCI 34570 14:24:16.027774 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:16.040381 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:16.054132 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:16.066701 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:16.079644 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:16.092071 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:24:16.241484 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:24:16.394405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:16.915132 run create_hlr_db(pid=31367): Launched 14:24:17.085110 bus /sierra_2: Setting Powered False 14:24:18.148786 run create_hlr_db(pid=31367): Terminated: ok {rc=0} 14:24:18.581764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Launched 14:24:18.914639 run osmo-hlr_10.42.42.2(pid=31370): Launched 14:24:19.043320 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:19.586174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Launched 14:24:19.920746 run osmo-stp_10.42.42.5(pid=31373): Launched 14:24:20.049469 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:20.622000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Launched 14:24:20.955248 run osmo-msc_10.42.42.6(pid=31376): Launched 14:24:21.142197 run osmo-stp_10.42.42.5(pid=31373): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] 14:24:21.282195 run osmo-stp_10.42.42.5(pid=31373): stdout: | (launched: 2022-12-13_14:24:19.859061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:21.422618 run osmo-stp_10.42.42.5(pid=31373): stderr: | 20221213142420052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142420052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142420053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142420053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142420054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142420054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142420054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:21.562023 run osmo-stp_10.42.42.5(pid=31373): stdout: | (launched: 2022-12-13_14:24:19.859061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:21.693448 run osmo-stp_10.42.42.5(pid=31373): stderr: | 20221213142420052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142420052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142420053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142420053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142420054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142420054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142420054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:21.851244 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31373): Process ended prematurely: osmo-stp_10.42.42.5(pid=31373) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 14:24:21.860239 tst handover.py:18: Test FAILED (7.0 sec) 14:24:21.887753 run osmo-hlr_10.42.42.2(pid=31370): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31370)] 14:24:21.937643 run osmo-hlr_10.42.42.2(pid=31370): stdout: | (launched: 2022-12-13_14:24:18.853289) 14:24:21.989311 run osmo-hlr_10.42.42.2(pid=31370): stderr: | 20221213142419052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142419052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142419052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142419052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142419052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142419052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142419065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142419074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142419074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142419074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:22.061519 run osmo-msc_10.42.42.6(pid=31376): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31376)] 14:24:22.111264 run osmo-msc_10.42.42.6(pid=31376): stdout: | (launched: 2022-12-13_14:24:20.893778) 14:24:22.162773 run osmo-msc_10.42.42.6(pid=31376): stderr: | 20221213142421216 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142421216 DLGLOBAL DEBUG validating counter group 0x7f566d737c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142421216 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142421216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142421216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142421217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142421218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142421219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142421219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142421219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:22.214404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Terminating (SIGTERM) 14:24:22.256168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Terminating (SIGTERM) 14:24:22.298139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Terminating (SIGTERM) 14:24:22.340251 --- ParallelTerminationStrategy: PID 31369 died... 14:24:22.360299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Terminated: ok {rc=0} 14:24:22.406415 --- ParallelTerminationStrategy: PID 31372 died... 14:24:22.425993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Terminated: ok {rc=0} 14:24:22.471749 --- ParallelTerminationStrategy: PID 31375 died... 14:24:22.491245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Terminated: ok {rc=0} 14:24:22.578341 bus /sierra_3: Setting Powered False 14:24:23.676681 bus /sierra_3: Setting Powered False 14:24:24.792632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 14:24:26.052314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:26.058606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:24:26.119761 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:24:26.147215 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:24:26.202322 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:24:26.262243 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:24:26.289034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:24:26.838564 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 14:24:26.845420 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:26.856877 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:24:26.902223 tst handover.py: using LAC 34570 14:24:27.024402 tst handover.py: using RAC 145 14:24:27.148221 tst handover.py: using CellId 34570 14:24:27.270970 tst handover.py: using BVCI 34571 14:24:27.385535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:24:27.439020 tst handover.py: using LAC 34571 14:24:27.568431 tst handover.py: using RAC 146 14:24:27.698222 tst handover.py: using CellId 34571 14:24:27.828279 tst handover.py: using BVCI 34572 14:24:27.948541 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:27.960314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:27.971950 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:27.983510 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:27.995627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:24:28.007713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:24:28.128777 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:24:28.250738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:28.737769 run create_hlr_db(pid=31381): Launched 14:24:28.874149 bus /sierra_2: Setting Powered False 14:24:29.939397 run create_hlr_db(pid=31381): Terminated: ok {rc=0} 14:24:30.373926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Launched 14:24:30.709190 run osmo-hlr_10.42.42.2(pid=31384): Launched 14:24:30.856672 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:31.534744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Launched 14:24:31.874984 run osmo-stp_10.42.42.5(pid=31387): Launched 14:24:32.159542 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:32.731099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Launched 14:24:33.045013 run osmo-msc_10.42.42.6(pid=31390): Launched 14:24:33.219299 run osmo-stp_10.42.42.5(pid=31387): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] 14:24:33.350641 run osmo-stp_10.42.42.5(pid=31387): stdout: | (launched: 2022-12-13_14:24:31.816215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:33.481457 run osmo-stp_10.42.42.5(pid=31387): stderr: | 20221213142432070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142432070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142432070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142432071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142432071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142432071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142432071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:33.610946 run osmo-stp_10.42.42.5(pid=31387): stdout: | (launched: 2022-12-13_14:24:31.816215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:33.734235 run osmo-stp_10.42.42.5(pid=31387): stderr: | 20221213142432070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142432070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142432070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142432071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142432071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142432071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142432071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:33.881558 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31387): Process ended prematurely: osmo-stp_10.42.42.5(pid=31387) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 14:24:33.890170 tst handover.py:18: Test FAILED (7.0 sec) 14:24:33.916657 run osmo-hlr_10.42.42.2(pid=31384): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31384)] 14:24:33.965296 run osmo-hlr_10.42.42.2(pid=31384): stdout: | (launched: 2022-12-13_14:24:30.647590) 14:24:34.014880 run osmo-hlr_10.42.42.2(pid=31384): stderr: | 20221213142430888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142430888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142430888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142430888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142430888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142430888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142430909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142430931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142430931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142430931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:34.084860 run osmo-msc_10.42.42.6(pid=31390): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31390)] 14:24:34.132678 run osmo-msc_10.42.42.6(pid=31390): stdout: | (launched: 2022-12-13_14:24:32.986778) 14:24:34.181881 run osmo-msc_10.42.42.6(pid=31390): stderr: | 20221213142433259 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142433259 DLGLOBAL DEBUG validating counter group 0x7f80e621ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142433259 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142433259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142433259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142433259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142433261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142433262 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142433262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142433262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:34.231464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Terminating (SIGTERM) 14:24:34.271553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Terminating (SIGTERM) 14:24:34.312178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Terminating (SIGTERM) 14:24:34.353097 --- ParallelTerminationStrategy: PID 31383 died... 14:24:34.372618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Terminated: ok {rc=0} 14:24:34.416825 --- ParallelTerminationStrategy: PID 31386 died... 14:24:34.435949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Terminated: ok {rc=0} 14:24:34.479833 --- ParallelTerminationStrategy: PID 31389 died... 14:24:34.498924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Terminated: ok {rc=0} 14:24:34.584788 bus /sierra_3: Setting Powered False 14:24:35.682580 bus /sierra_3: Setting Powered False 14:24:36.800434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 14:24:38.071651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:38.077073 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:24:38.136902 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:24:38.163533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:24:38.218675 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:24:38.278917 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:24:38.306285 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:24:38.858837 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 14:24:38.864594 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:38.876357 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:24:38.921426 tst handover.py: using LAC 34572 14:24:39.043668 tst handover.py: using RAC 147 14:24:39.175899 tst handover.py: using CellId 34572 14:24:39.308318 tst handover.py: using BVCI 34573 14:24:39.430013 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:24:39.478534 tst handover.py: using LAC 34573 14:24:39.603079 tst handover.py: using RAC 148 14:24:39.726663 tst handover.py: using CellId 34573 14:24:39.851091 tst handover.py: using BVCI 34574 14:24:39.963853 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:39.975049 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:39.986050 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:39.997000 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:40.008207 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:24:40.019452 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:24:40.143511 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:24:40.265121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:40.753911 run create_hlr_db(pid=31396): Launched 14:24:40.891432 bus /sierra_2: Setting Powered False 14:24:41.956844 run create_hlr_db(pid=31396): Terminated: ok {rc=0} 14:24:42.377085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31398): Launched 14:24:42.690447 run osmo-hlr_10.42.42.2(pid=31399): Launched 14:24:42.810576 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:43.322773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31401): Launched 14:24:43.636263 run osmo-stp_10.42.42.5(pid=31402): Launched 14:24:43.760709 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:44.296394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31404): Launched 14:24:44.611316 run osmo-msc_10.42.42.6(pid=31405): Launched 14:24:44.790162 run osmo-stp_10.42.42.5(pid=31402): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31402)] 14:24:44.921653 run osmo-stp_10.42.42.5(pid=31402): stdout: | (launched: 2022-12-13_14:24:43.578178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:45.051870 run osmo-stp_10.42.42.5(pid=31402): stderr: | 20221213142443749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142443749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142443749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142443750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142443750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142443750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142443750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:45.180398 run osmo-stp_10.42.42.5(pid=31402): stdout: | (launched: 2022-12-13_14:24:43.578178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:45.303036 run osmo-stp_10.42.42.5(pid=31402): stderr: | 20221213142443749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142443749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142443749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142443750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142443750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142443750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142443750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:45.450129 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31402): Process ended prematurely: osmo-stp_10.42.42.5(pid=31402) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31402)] [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 14:24:45.458622 tst handover.py:18: Test FAILED (6.6 sec) 14:24:45.485156 run osmo-hlr_10.42.42.2(pid=31399): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31399)] 14:24:45.533559 run osmo-hlr_10.42.42.2(pid=31399): stdout: | (launched: 2022-12-13_14:24:42.632217) 14:24:45.583392 run osmo-hlr_10.42.42.2(pid=31399): stderr: | 20221213142442807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142442807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142442807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142442807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142442807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142442807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142442820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142442830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142442830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142442830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:45.652180 run osmo-msc_10.42.42.6(pid=31405): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31405)] 14:24:45.699405 run osmo-msc_10.42.42.6(pid=31405): stdout: | (launched: 2022-12-13_14:24:44.553126) 14:24:45.748939 run osmo-msc_10.42.42.6(pid=31405): stderr: | 20221213142444823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142444823 DLGLOBAL DEBUG validating counter group 0x7f6de3e05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142444823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142444823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142444823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142444824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142444825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142444826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142444826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142444826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:45.798896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31398): Terminating (SIGTERM) 14:24:45.838865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31401): Terminating (SIGTERM) 14:24:45.892631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31404): Terminating (SIGTERM) 14:24:45.933224 --- ParallelTerminationStrategy: PID 31398 died... 14:24:45.952769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31398): Terminated: ok {rc=0} 14:24:45.997415 --- ParallelTerminationStrategy: PID 31401 died... 14:24:46.016842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31401): Terminated: ok {rc=0} 14:24:46.061542 --- ParallelTerminationStrategy: PID 31404 died... 14:24:46.081235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31404): Terminated: ok {rc=0} 14:24:46.174731 bus /sierra_3: Setting Powered False 14:24:47.292041 bus /sierra_3: Setting Powered False 14:24:48.411008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 14:24:49.677572 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:49.683302 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:24:49.735513 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:24:49.762420 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:24:49.816535 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:24:49.868176 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:24:49.894670 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:24:50.443291 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 14:24:50.449185 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:50.460296 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:24:50.508744 tst handover.py: using LAC 34574 14:24:50.631530 tst handover.py: using RAC 149 14:24:50.755010 tst handover.py: using CellId 34574 14:24:50.878763 tst handover.py: using BVCI 34575 14:24:50.992363 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:24:51.027895 tst handover.py: using LAC 34575 14:24:51.159369 tst handover.py: using RAC 150 14:24:51.291530 tst handover.py: using CellId 34575 14:24:51.423715 tst handover.py: using BVCI 34576 14:24:51.546952 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:51.558535 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:51.569880 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:51.581630 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:51.593616 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:24:51.605533 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:24:51.725943 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:24:51.843314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:52.301111 run create_hlr_db(pid=31410): Launched 14:24:52.421731 bus /sierra_2: Setting Powered False 14:24:53.483633 run create_hlr_db(pid=31410): Terminated: ok {rc=0} 14:24:53.912499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31413): Launched 14:24:54.249020 run osmo-hlr_10.42.42.2(pid=31414): Launched 14:24:54.379025 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:54.924096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31416): Launched 14:24:55.258463 run osmo-stp_10.42.42.5(pid=31417): Launched 14:24:55.385761 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:55.960347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31419): Launched 14:24:56.295846 run osmo-msc_10.42.42.6(pid=31420): Launched 14:24:56.482623 run osmo-stp_10.42.42.5(pid=31417): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31417)] 14:24:56.622629 run osmo-stp_10.42.42.5(pid=31417): stdout: | (launched: 2022-12-13_14:24:55.196438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:56.763273 run osmo-stp_10.42.42.5(pid=31417): stderr: | 20221213142455389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142455389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142455389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142455390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142455390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142455390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142455390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:56.901176 run osmo-stp_10.42.42.5(pid=31417): stdout: | (launched: 2022-12-13_14:24:55.196438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:57.032712 run osmo-stp_10.42.42.5(pid=31417): stderr: | 20221213142455389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142455389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142455389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142455390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142455390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142455390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142455390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:57.190120 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31417): Process ended prematurely: osmo-stp_10.42.42.5(pid=31417) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31417)] [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 14:24:57.199221 tst handover.py:18: Test FAILED (6.7 sec) 14:24:57.226955 run osmo-hlr_10.42.42.2(pid=31414): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31414)] 14:24:57.276927 run osmo-hlr_10.42.42.2(pid=31414): stdout: | (launched: 2022-12-13_14:24:54.187196) 14:24:57.328619 run osmo-hlr_10.42.42.2(pid=31414): stderr: | 20221213142454385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142454385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142454385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142454386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142454386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142454386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142454398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142454408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142454408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142454408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:57.400881 run osmo-msc_10.42.42.6(pid=31420): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31420)] 14:24:57.450441 run osmo-msc_10.42.42.6(pid=31420): stdout: | (launched: 2022-12-13_14:24:56.233976) 14:24:57.501793 run osmo-msc_10.42.42.6(pid=31420): stderr: | 20221213142456557 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142456557 DLGLOBAL DEBUG validating counter group 0x7f43d0037c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142456557 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142456557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142456558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142456558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142456559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142456560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142456560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142456560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:57.553598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31413): Terminating (SIGTERM) 14:24:57.595782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31416): Terminating (SIGTERM) 14:24:57.637658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31419): Terminating (SIGTERM) 14:24:57.680072 --- ParallelTerminationStrategy: PID 31413 died... 14:24:57.700273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31413): Terminated: ok {rc=0} 14:24:57.746695 --- ParallelTerminationStrategy: PID 31416 died... 14:24:57.766349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31416): Terminated: ok {rc=0} 14:24:57.812925 --- ParallelTerminationStrategy: PID 31419 died... 14:24:57.833097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31419): Terminated: ok {rc=0} 14:24:57.921835 bus /sierra_3: Setting Powered False 14:24:59.021342 bus /sierra_3: Setting Powered False 14:25:00.138306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 14:25:01.430803 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:01.438946 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:25:01.519137 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:25:01.554311 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:25:01.621153 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:25:01.717254 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:25:01.746257 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:25:02.265591 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 14:25:02.271843 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:02.285368 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:25:02.334712 tst handover.py: using LAC 34576 14:25:02.455089 tst handover.py: using RAC 151 14:25:02.575807 tst handover.py: using CellId 34576 14:25:02.696345 tst handover.py: using BVCI 34577 14:25:02.812154 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:25:02.859477 tst handover.py: using LAC 34577 14:25:02.990507 tst handover.py: using RAC 152 14:25:03.121737 tst handover.py: using CellId 34577 14:25:03.251314 tst handover.py: using BVCI 34578 14:25:03.371815 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:03.383278 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:03.394760 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:03.406181 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:03.417491 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:03.428756 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:25:03.547739 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:25:03.667244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:04.123124 run create_hlr_db(pid=31428): Launched 14:25:04.244354 bus /sierra_2: Setting Powered False 14:25:05.306071 run create_hlr_db(pid=31428): Terminated: ok {rc=0} 14:25:05.733635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31430): Launched 14:25:06.071218 run osmo-hlr_10.42.42.2(pid=31431): Launched 14:25:06.201014 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:06.744823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31433): Launched 14:25:07.077616 run osmo-stp_10.42.42.5(pid=31434): Launched 14:25:07.204812 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:07.778888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31436): Launched 14:25:08.113672 run osmo-msc_10.42.42.6(pid=31437): Launched 14:25:08.299261 run osmo-stp_10.42.42.5(pid=31434): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31434)] 14:25:08.438441 run osmo-stp_10.42.42.5(pid=31434): stdout: | (launched: 2022-12-13_14:25:07.015950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:08.578900 run osmo-stp_10.42.42.5(pid=31434): stderr: | 20221213142507208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142507208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142507208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142507208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142507209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142507209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142507209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:08.718622 run osmo-stp_10.42.42.5(pid=31434): stdout: | (launched: 2022-12-13_14:25:07.015950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:08.850803 run osmo-stp_10.42.42.5(pid=31434): stderr: | 20221213142507208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142507208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142507208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142507208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142507209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142507209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142507209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:09.008929 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31434): Process ended prematurely: osmo-stp_10.42.42.5(pid=31434) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31434)] [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 14:25:09.018198 tst handover.py:18: Test FAILED (6.7 sec) 14:25:09.045818 run osmo-hlr_10.42.42.2(pid=31431): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31431)] 14:25:09.096258 run osmo-hlr_10.42.42.2(pid=31431): stdout: | (launched: 2022-12-13_14:25:06.009548) 14:25:09.148061 run osmo-hlr_10.42.42.2(pid=31431): stderr: | 20221213142506208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142506208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142506208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142506208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142506208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142506208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142506221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142506230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142506230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142506230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:09.220073 run osmo-msc_10.42.42.6(pid=31437): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31437)] 14:25:09.269725 run osmo-msc_10.42.42.6(pid=31437): stdout: | (launched: 2022-12-13_14:25:08.052021) 14:25:09.320891 run osmo-msc_10.42.42.6(pid=31437): stderr: | 20221213142508376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142508376 DLGLOBAL DEBUG validating counter group 0x7fdacd3e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142508376 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142508376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142508376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142508377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142508378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142508379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142508379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142508379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:09.372733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31430): Terminating (SIGTERM) 14:25:09.414293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31433): Terminating (SIGTERM) 14:25:09.455999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31436): Terminating (SIGTERM) 14:25:09.497861 --- ParallelTerminationStrategy: PID 31430 died... 14:25:09.518094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31430): Terminated: ok {rc=0} 14:25:09.564214 --- ParallelTerminationStrategy: PID 31433 died... 14:25:09.584113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31433): Terminated: ok {rc=0} 14:25:09.630568 --- ParallelTerminationStrategy: PID 31436 died... 14:25:09.650431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31436): Terminated: ok {rc=0} 14:25:09.740091 bus /sierra_3: Setting Powered False 14:25:10.838993 bus /sierra_3: Setting Powered False 14:25:11.955309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 14:25:13.232846 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:13.239186 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:25:13.303704 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:25:13.331152 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:25:13.384852 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:25:13.449099 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:25:13.475499 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:25:14.026138 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 14:25:14.031421 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:14.042843 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:14.092129 tst handover.py: using LAC 34578 14:25:14.222322 tst handover.py: using RAC 153 14:25:14.353323 tst handover.py: using CellId 34578 14:25:14.482079 tst handover.py: using BVCI 34579 14:25:14.598321 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:14.646720 tst handover.py: using LAC 34579 14:25:14.777027 tst handover.py: using RAC 154 14:25:14.906920 tst handover.py: using CellId 34579 14:25:15.040897 tst handover.py: using BVCI 34580 14:25:15.163670 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:15.175326 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:15.186994 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:15.198421 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:15.210181 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:15.221482 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:15.341973 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:15.463183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:15.969749 run create_hlr_db(pid=31442): Launched 14:25:16.157555 bus /sierra_2: Setting Powered False 14:25:17.236360 run create_hlr_db(pid=31442): Terminated: ok {rc=0} 14:25:17.659004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31444): Launched 14:25:17.972216 run osmo-hlr_10.42.42.2(pid=31445): Launched 14:25:18.091471 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:18.602810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31447): Launched 14:25:18.916487 run osmo-stp_10.42.42.5(pid=31448): Launched 14:25:19.035820 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:19.569223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31450): Launched 14:25:19.881915 run osmo-msc_10.42.42.6(pid=31451): Launched 14:25:20.058296 run osmo-stp_10.42.42.5(pid=31448): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31448)] 14:25:20.189798 run osmo-stp_10.42.42.5(pid=31448): stdout: | (launched: 2022-12-13_14:25:18.858650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:20.320599 run osmo-stp_10.42.42.5(pid=31448): stderr: | 20221213142519028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142519028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142519029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142519029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142519030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142519030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142519030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:20.449548 run osmo-stp_10.42.42.5(pid=31448): stdout: | (launched: 2022-12-13_14:25:18.858650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:20.572202 run osmo-stp_10.42.42.5(pid=31448): stderr: | 20221213142519028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142519028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142519029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142519029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142519030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142519030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142519030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:20.719491 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31448): Process ended prematurely: osmo-stp_10.42.42.5(pid=31448) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31448)] [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 14:25:20.728049 tst handover.py:18: Test FAILED (6.7 sec) 14:25:20.754354 run osmo-hlr_10.42.42.2(pid=31445): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31445)] 14:25:20.803420 run osmo-hlr_10.42.42.2(pid=31445): stdout: | (launched: 2022-12-13_14:25:17.914452) 14:25:20.853228 run osmo-hlr_10.42.42.2(pid=31445): stderr: | 20221213142518089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142518089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142518089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142518089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142518089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142518089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142518105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142518115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142518115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142518115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:20.922880 run osmo-msc_10.42.42.6(pid=31451): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31451)] 14:25:20.970428 run osmo-msc_10.42.42.6(pid=31451): stdout: | (launched: 2022-12-13_14:25:19.823937) 14:25:21.019858 run osmo-msc_10.42.42.6(pid=31451): stderr: | 20221213142520093 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142520093 DLGLOBAL DEBUG validating counter group 0x7f1be1d8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142520093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142520093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142520093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142520094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142520095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142520096 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142520096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142520096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:21.069891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31444): Terminating (SIGTERM) 14:25:21.110163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31447): Terminating (SIGTERM) 14:25:21.150489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31450): Terminating (SIGTERM) 14:25:21.190980 --- ParallelTerminationStrategy: PID 31444 died... 14:25:21.210722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31444): Terminated: ok {rc=0} 14:25:21.255550 --- ParallelTerminationStrategy: PID 31447 died... 14:25:21.274946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31447): Terminated: ok {rc=0} 14:25:21.319324 --- ParallelTerminationStrategy: PID 31450 died... 14:25:21.338580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31450): Terminated: ok {rc=0} 14:25:21.426038 bus /sierra_3: Setting Powered False 14:25:22.525259 bus /sierra_3: Setting Powered False 14:25:23.640353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 14:25:24.908421 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:24.913638 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:25:24.965447 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:25:24.991881 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:25:25.044752 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:25:25.097973 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:25:25.125477 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:25:25.674883 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 14:25:25.681316 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:25.692820 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:25:25.727858 tst handover.py: using LAC 34580 14:25:25.850301 tst handover.py: using RAC 155 14:25:25.974422 tst handover.py: using CellId 34580 14:25:26.099168 tst handover.py: using BVCI 34581 14:25:26.214041 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:25:26.262662 tst handover.py: using LAC 34581 14:25:26.386373 tst handover.py: using RAC 156 14:25:26.513702 tst handover.py: using CellId 34581 14:25:26.636120 tst handover.py: using BVCI 34582 14:25:26.749455 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:26.760349 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:26.771009 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:26.781681 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:26.793207 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:25:26.804666 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:25:26.927622 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:25:27.045818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:27.499717 run create_hlr_db(pid=31457): Launched 14:25:27.619052 bus /sierra_2: Setting Powered False 14:25:28.680537 run create_hlr_db(pid=31457): Terminated: ok {rc=0} 14:25:29.087819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Launched 14:25:29.401707 run osmo-hlr_10.42.42.2(pid=31460): Launched 14:25:29.520152 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:30.042466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Launched 14:25:30.356331 run osmo-stp_10.42.42.5(pid=31463): Launched 14:25:30.476760 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:31.025682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Launched 14:25:31.375236 run osmo-msc_10.42.42.6(pid=31466): Launched 14:25:31.763499 run osmo-stp_10.42.42.5(pid=31463): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] 14:25:31.950580 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-13_14:25:30.298403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:32.186329 run osmo-stp_10.42.42.5(pid=31463): stderr: | 20221213142530467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142530467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142530468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142530468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142530469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142530469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142530469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:32.324800 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-13_14:25:30.298403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:32.456674 run osmo-stp_10.42.42.5(pid=31463): stderr: | 20221213142530467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142530467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142530468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142530468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142530469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142530469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142530469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:32.615401 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 14:25:32.624389 tst handover.py:18: Test FAILED (6.9 sec) 14:25:32.652367 run osmo-hlr_10.42.42.2(pid=31460): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31460)] 14:25:32.703033 run osmo-hlr_10.42.42.2(pid=31460): stdout: | (launched: 2022-12-13_14:25:29.343737) 14:25:32.754688 run osmo-hlr_10.42.42.2(pid=31460): stderr: | 20221213142529518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142529518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142529518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142529518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142529518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142529518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142529531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142529541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142529542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142529542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:32.826871 run osmo-msc_10.42.42.6(pid=31466): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31466)] 14:25:32.876835 run osmo-msc_10.42.42.6(pid=31466): stdout: | (launched: 2022-12-13_14:25:31.311762) 14:25:32.928493 run osmo-msc_10.42.42.6(pid=31466): stderr: | 20221213142531815 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142531816 DLGLOBAL DEBUG validating counter group 0x7f3101125c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142531816 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142531816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142531816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142531816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142531818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142531818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142531818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142531818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:32.980652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminating (SIGTERM) 14:25:33.022691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminating (SIGTERM) 14:25:33.065759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Terminating (SIGTERM) 14:25:33.108649 --- ParallelTerminationStrategy: PID 31459 died... 14:25:33.129074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminated: ok {rc=0} 14:25:33.175768 --- ParallelTerminationStrategy: PID 31462 died... 14:25:33.195654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminated: ok {rc=0} 14:25:33.242117 --- ParallelTerminationStrategy: PID 31465 died... 14:25:33.261959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Terminated: ok {rc=0} 14:25:33.351294 bus /sierra_3: Setting Powered False 14:25:34.450531 bus /sierra_3: Setting Powered False 14:25:35.567098 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 14:25:36.827667 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:36.833539 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:25:36.885183 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:25:36.912509 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:25:36.967626 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:25:37.019588 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:25:37.047038 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:25:37.595958 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 14:25:37.601909 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:37.613323 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:37.650574 tst handover.py: using LAC 34582 14:25:37.773420 tst handover.py: using RAC 157 14:25:37.895441 tst handover.py: using CellId 34582 14:25:38.017531 tst handover.py: using BVCI 34583 14:25:38.139149 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:38.190233 tst handover.py: using LAC 34583 14:25:38.319073 tst handover.py: using RAC 158 14:25:38.447398 tst handover.py: using CellId 34583 14:25:38.575746 tst handover.py: using BVCI 34584 14:25:38.697915 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:38.709157 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:38.720179 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:38.731293 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:38.742573 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:38.753790 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:38.876259 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:38.997301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:39.484808 run create_hlr_db(pid=31471): Launched 14:25:39.622586 bus /sierra_2: Setting Powered False 14:25:40.687832 run create_hlr_db(pid=31471): Terminated: ok {rc=0} 14:25:41.124003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Launched 14:25:41.459356 run osmo-hlr_10.42.42.2(pid=31474): Launched 14:25:41.588082 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:42.136651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Launched 14:25:42.472680 run osmo-stp_10.42.42.5(pid=31477): Launched 14:25:42.601577 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:43.176698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Launched 14:25:43.511473 run osmo-msc_10.42.42.6(pid=31480): Launched 14:25:43.700350 run osmo-stp_10.42.42.5(pid=31477): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] 14:25:43.841290 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-13_14:25:42.410926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:43.981073 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221213142542605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142542605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142542605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142542606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142542606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142542606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142542606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:44.119329 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-13_14:25:42.410926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:44.251495 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221213142542605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142542605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142542605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142542606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142542606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142542606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142542606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:44.409615 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 14:25:44.418640 tst handover.py:18: Test FAILED (6.8 sec) 14:25:44.446514 run osmo-hlr_10.42.42.2(pid=31474): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31474)] 14:25:44.497144 run osmo-hlr_10.42.42.2(pid=31474): stdout: | (launched: 2022-12-13_14:25:41.397533) 14:25:44.549079 run osmo-hlr_10.42.42.2(pid=31474): stderr: | 20221213142541596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142541596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142541596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142541596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142541596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142541596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142541608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142541618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142541618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142541618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:44.622856 run osmo-msc_10.42.42.6(pid=31480): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31480)] 14:25:44.673221 run osmo-msc_10.42.42.6(pid=31480): stdout: | (launched: 2022-12-13_14:25:43.449769) 14:25:44.725058 run osmo-msc_10.42.42.6(pid=31480): stderr: | 20221213142543774 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142543774 DLGLOBAL DEBUG validating counter group 0x7f9130f1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142543774 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142543774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142543774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142543775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142543776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142543777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142543777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142543777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:44.778660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminating (SIGTERM) 14:25:44.820763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminating (SIGTERM) 14:25:44.863456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminating (SIGTERM) 14:25:44.906183 --- ParallelTerminationStrategy: PID 31473 died... 14:25:44.926428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminated: ok {rc=0} 14:25:44.973231 --- ParallelTerminationStrategy: PID 31476 died... 14:25:44.993018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminated: ok {rc=0} 14:25:45.039716 --- ParallelTerminationStrategy: PID 31479 died... 14:25:45.059612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminated: ok {rc=0} 14:25:45.148731 bus /sierra_3: Setting Powered False 14:25:46.246018 bus /sierra_3: Setting Powered False 14:25:47.363680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2390 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 14:25:48.622001 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:48.627559 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:25:48.690338 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:25:48.716937 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:25:48.767557 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:25:48.830155 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:25:48.856580 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:25:49.409114 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2390 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 14:25:49.414384 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:49.425266 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:49.472705 tst handover.py: using LAC 34584 14:25:49.593593 tst handover.py: using RAC 159 14:25:49.725261 tst handover.py: using CellId 34584 14:25:49.854360 tst handover.py: using BVCI 34585 14:25:49.976547 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:25:50.024250 tst handover.py: using LAC 34585 14:25:50.154197 tst handover.py: using RAC 160 14:25:50.275932 tst handover.py: using CellId 34585 14:25:50.397114 tst handover.py: using BVCI 34586 14:25:50.509949 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:50.520732 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:50.531519 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:50.542308 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:50.553292 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:25:50.564822 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:50.688434 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:25:50.810011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:51.266918 run create_hlr_db(pid=31486): Launched 14:25:51.388047 bus /sierra_2: Setting Powered False 14:25:52.450538 run create_hlr_db(pid=31486): Terminated: ok {rc=0} 14:25:52.859793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Launched 14:25:53.175591 run osmo-hlr_10.42.42.2(pid=31490): Launched 14:25:53.297297 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:53.823179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Launched 14:25:54.137149 run osmo-stp_10.42.42.5(pid=31493): Launched 14:25:54.258030 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:54.794104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31495): Launched 14:25:55.108566 run osmo-msc_10.42.42.6(pid=31496): Launched 14:25:55.285835 run osmo-stp_10.42.42.5(pid=31493): ERR: Terminated: ERROR {rc=1} [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31493)] 14:25:55.417619 run osmo-stp_10.42.42.5(pid=31493): stdout: | (launched: 2022-12-13_14:25:54.078564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:55.549099 run osmo-stp_10.42.42.5(pid=31493): stderr: | 20221213142554251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142554251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142554251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142554252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142554252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142554252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142554252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:55.678457 run osmo-stp_10.42.42.5(pid=31493): stdout: | (launched: 2022-12-13_14:25:54.078564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:55.801531 run osmo-stp_10.42.42.5(pid=31493): stderr: | 20221213142554251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213142554251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213142554251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213142554252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213142554252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213142554252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213142554252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:55.948809 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31493): Process ended prematurely: osmo-stp_10.42.42.5(pid=31493) [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31493)] [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 14:25:55.957528 tst handover.py:18: Test FAILED (6.5 sec) 14:25:55.984305 run osmo-hlr_10.42.42.2(pid=31490): ERR: Terminated: ERROR {rc=237} [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31490)] 14:25:56.033407 run osmo-hlr_10.42.42.2(pid=31490): stdout: | (launched: 2022-12-13_14:25:53.117465) 14:25:56.083532 run osmo-hlr_10.42.42.2(pid=31490): stderr: | 20221213142553292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213142553292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213142553292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213142553292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213142553293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213142553293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213142553304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213142553312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213142553313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213142553313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:56.153874 run osmo-msc_10.42.42.6(pid=31496): ERR: Terminated: ERROR {rc=2} [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31496)] 14:25:56.201999 run osmo-msc_10.42.42.6(pid=31496): stdout: | (launched: 2022-12-13_14:25:55.050242) 14:25:56.252022 run osmo-msc_10.42.42.6(pid=31496): stderr: | 20221213142555321 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213142555321 DLGLOBAL DEBUG validating counter group 0x7fe54b7e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213142555321 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213142555321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213142555321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213142555322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213142555323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213142555324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213142555324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213142555324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:56.302801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Terminating (SIGTERM) 14:25:56.343442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Terminating (SIGTERM) 14:25:56.384101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31495): Terminating (SIGTERM) 14:25:56.425182 --- ParallelTerminationStrategy: PID 31489 died... 14:25:56.445216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31489): Terminated: ok {rc=0} 14:25:56.490150 --- ParallelTerminationStrategy: PID 31492 died... 14:25:56.509410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31492): Terminated: ok {rc=0} 14:25:56.554100 --- ParallelTerminationStrategy: PID 31495 died... 14:25:56.573483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31495): Terminated: ok {rc=0} 14:25:56.660886 bus /sierra_3: Setting Powered False 14:25:57.761430 bus /sierra_3: Setting Powered False 14:25:58.876793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2390 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 14:26:00.154601 tst trial-2390: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390/run.2022-12-13_13-01-08/trial-2390.xml -------------------------------------------------------------------------------------------- trial-2390 FAIL -------------------------------------------------------------------------------------------- 14:26:02.141546 tst trial-2390: trial-2390: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=24075): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24075) [trial-2390↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24075)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.7 sec) Error: osmo-stp_10.42.42.5(pid=24085): Process ended prematurely: osmo-stp_10.42.42.5(pid=24085) [trial-2390↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24085)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=24094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24094) [trial-2390↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24094)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24106): Process ended prematurely: osmo-stp_10.42.42.5(pid=24106) [trial-2390↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24106)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24121): Process ended prematurely: osmo-stp_10.42.42.5(pid=24121) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24121)] FAIL: mo_mt_call_osmux.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=24132): Process ended prematurely: osmo-stp_10.42.42.5(pid=24132) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24132)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24146): Process ended prematurely: osmo-stp_10.42.42.5(pid=24146) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24146)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24157): Process ended prematurely: osmo-stp_10.42.42.5(pid=24157) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24157)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24171): Process ended prematurely: osmo-stp_10.42.42.5(pid=24171) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24182): Process ended prematurely: osmo-stp_10.42.42.5(pid=24182) [trial-2390↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24182)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24200): Process ended prematurely: osmo-stp_10.42.42.5(pid=24200) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24200)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24225): Process ended prematurely: osmo-stp_10.42.42.5(pid=24225) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24225)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24237): Process ended prematurely: osmo-stp_10.42.42.5(pid=24237) [trial-2390↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24253): Process ended prematurely: osmo-stp_10.42.42.5(pid=24253) [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24253)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24264): Process ended prematurely: osmo-stp_10.42.42.5(pid=24264) [trial-2390↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24264)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24278): Process ended prematurely: osmo-stp_10.42.42.5(pid=24278) [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24278)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24289): Process ended prematurely: osmo-stp_10.42.42.5(pid=24289) [trial-2390↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24289)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24303): Process ended prematurely: osmo-stp_10.42.42.5(pid=24303) [trial-2390↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24303)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24314): Process ended prematurely: osmo-stp_10.42.42.5(pid=24314) [trial-2390↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24314)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=24333): Process ended prematurely: osmo-stp_10.42.42.5(pid=24333) [trial-2390↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24333)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2390↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=24363): Process ended prematurely: osmo-stp_10.42.42.5(pid=24363) [trial-2390↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24363)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24381): Process ended prematurely: osmo-stp_10.42.42.5(pid=24381) [trial-2390↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24391): Process ended prematurely: osmo-stp_10.42.42.5(pid=24391) [trial-2390↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24391)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24408): Process ended prematurely: osmo-stp_10.42.42.5(pid=24408) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24420): Process ended prematurely: osmo-stp_10.42.42.5(pid=24420) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24420)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=24438): Process ended prematurely: osmo-stp_10.42.42.5(pid=24438) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24438)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24731): Process ended prematurely: osmo-stp_10.42.42.5(pid=24731) [trial-2390↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24731)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=24748): Process ended prematurely: osmo-stp_10.42.42.5(pid=24748) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24760): Process ended prematurely: osmo-stp_10.42.42.5(pid=24760) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24778): Process ended prematurely: osmo-stp_10.42.42.5(pid=24778) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24788): Process ended prematurely: osmo-stp_10.42.42.5(pid=24788) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24798): Process ended prematurely: osmo-stp_10.42.42.5(pid=24798) [trial-2390↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24798)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24820): Process ended prematurely: osmo-stp_10.42.42.5(pid=24820) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24820)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24832): Process ended prematurely: osmo-stp_10.42.42.5(pid=24832) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24832)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=24850): Process ended prematurely: osmo-stp_10.42.42.5(pid=24850) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24850)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24863): Process ended prematurely: osmo-stp_10.42.42.5(pid=24863) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24863)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24873): Process ended prematurely: osmo-stp_10.42.42.5(pid=24873) [trial-2390↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24873)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24886): Process ended prematurely: osmo-stp_10.42.42.5(pid=24886) [trial-2390↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24899): Process ended prematurely: osmo-stp_10.42.42.5(pid=24899) [trial-2390↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24899)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24907) [trial-2390↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24907)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24917): Process ended prematurely: osmo-stp_10.42.42.5(pid=24917) [trial-2390↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24917)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=24926): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24926) [trial-2390↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24926)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24936): Process ended prematurely: osmo-stp_10.42.42.5(pid=24936) [trial-2390↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24936)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24950): Process ended prematurely: osmo-stp_10.42.42.5(pid=24950) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24950)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24961): Process ended prematurely: osmo-stp_10.42.42.5(pid=24961) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24961)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24975): Process ended prematurely: osmo-stp_10.42.42.5(pid=24975) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24975)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24986): Process ended prematurely: osmo-stp_10.42.42.5(pid=24986) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24986)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25000): Process ended prematurely: osmo-stp_10.42.42.5(pid=25000) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25000)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25011): Process ended prematurely: osmo-stp_10.42.42.5(pid=25011) [trial-2390↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25026): Process ended prematurely: osmo-stp_10.42.42.5(pid=25026) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25026)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25037): Process ended prematurely: osmo-stp_10.42.42.5(pid=25037) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25037)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25051): Process ended prematurely: osmo-stp_10.42.42.5(pid=25051) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25051)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25062): Process ended prematurely: osmo-stp_10.42.42.5(pid=25062) [trial-2390↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25062)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25088): Process ended prematurely: osmo-stp_10.42.42.5(pid=25088) [trial-2390↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25088)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25103): Process ended prematurely: osmo-stp_10.42.42.5(pid=25103) [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25114): Process ended prematurely: osmo-stp_10.42.42.5(pid=25114) [trial-2390↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25114)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25128): Process ended prematurely: osmo-stp_10.42.42.5(pid=25128) [trial-2390↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25128)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25139): Process ended prematurely: osmo-stp_10.42.42.5(pid=25139) [trial-2390↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25139)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=25160): Process ended prematurely: osmo-stp_10.42.42.5(pid=25160) [trial-2390↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25160)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25172): Process ended prematurely: osmo-stp_10.42.42.5(pid=25172) [trial-2390↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25172)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25191): Process ended prematurely: osmo-stp_10.42.42.5(pid=25191) [trial-2390↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25191)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25201): Process ended prematurely: osmo-stp_10.42.42.5(pid=25201) [trial-2390↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25214): Process ended prematurely: osmo-stp_10.42.42.5(pid=25214) [trial-2390↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25232): Process ended prematurely: osmo-stp_10.42.42.5(pid=25232) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25232)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25245): Process ended prematurely: osmo-stp_10.42.42.5(pid=25245) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25245)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=25264): Process ended prematurely: osmo-stp_10.42.42.5(pid=25264) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25264)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25274): Process ended prematurely: osmo-stp_10.42.42.5(pid=25274) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25274)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25284): Process ended prematurely: osmo-stp_10.42.42.5(pid=25284) [trial-2390↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25284)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25304): Process ended prematurely: osmo-stp_10.42.42.5(pid=25304) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25304)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25334): Process ended prematurely: osmo-stp_10.42.42.5(pid=25334) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25347): Process ended prematurely: osmo-stp_10.42.42.5(pid=25347) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25347)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25357): Process ended prematurely: osmo-stp_10.42.42.5(pid=25357) [trial-2390↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25357)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25374): Process ended prematurely: osmo-stp_10.42.42.5(pid=25374) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25374)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25386): Process ended prematurely: osmo-stp_10.42.42.5(pid=25386) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25404): Process ended prematurely: osmo-stp_10.42.42.5(pid=25404) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25404)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25414): Process ended prematurely: osmo-stp_10.42.42.5(pid=25414) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25424): Process ended prematurely: osmo-stp_10.42.42.5(pid=25424) [trial-2390↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25437): Process ended prematurely: osmo-stp_10.42.42.5(pid=25437) [trial-2390↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25437)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25450): Process ended prematurely: osmo-stp_10.42.42.5(pid=25450) [trial-2390↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=25458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25458) [trial-2390↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25458)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25468): Process ended prematurely: osmo-stp_10.42.42.5(pid=25468) [trial-2390↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25468)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25477) [trial-2390↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25477)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2390↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25501): Process ended prematurely: osmo-stp_10.42.42.5(pid=25501) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25530): Process ended prematurely: osmo-stp_10.42.42.5(pid=25530) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25541): Process ended prematurely: osmo-stp_10.42.42.5(pid=25541) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25556): Process ended prematurely: osmo-stp_10.42.42.5(pid=25556) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25556)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25582): Process ended prematurely: osmo-stp_10.42.42.5(pid=25582) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25582)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25593): Process ended prematurely: osmo-stp_10.42.42.5(pid=25593) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25609): Process ended prematurely: osmo-stp_10.42.42.5(pid=25609) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25609)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25620): Process ended prematurely: osmo-stp_10.42.42.5(pid=25620) [trial-2390↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25620)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25634): Process ended prematurely: osmo-stp_10.42.42.5(pid=25634) [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25634)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25645): Process ended prematurely: osmo-stp_10.42.42.5(pid=25645) [trial-2390↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25645)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25659): Process ended prematurely: osmo-stp_10.42.42.5(pid=25659) [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25659)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25670): Process ended prematurely: osmo-stp_10.42.42.5(pid=25670) [trial-2390↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25670)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25684): Process ended prematurely: osmo-stp_10.42.42.5(pid=25684) [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2390↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25721): Process ended prematurely: osmo-stp_10.42.42.5(pid=25721) [trial-2390↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25721)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25740): Process ended prematurely: osmo-stp_10.42.42.5(pid=25740) [trial-2390↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25740)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25751): Process ended prematurely: osmo-stp_10.42.42.5(pid=25751) [trial-2390↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25751)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25769): Process ended prematurely: osmo-stp_10.42.42.5(pid=25769) [trial-2390↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25769)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26053): Process ended prematurely: osmo-stp_10.42.42.5(pid=26053) [trial-2390↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26053)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2390↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26082): Process ended prematurely: osmo-stp_10.42.42.5(pid=26082) [trial-2390↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26082)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26092): Process ended prematurely: osmo-stp_10.42.42.5(pid=26092) [trial-2390↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26092)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26110): Process ended prematurely: osmo-stp_10.42.42.5(pid=26110) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26122): Process ended prematurely: osmo-stp_10.42.42.5(pid=26122) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26143): Process ended prematurely: osmo-stp_10.42.42.5(pid=26143) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26143)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26154): Process ended prematurely: osmo-stp_10.42.42.5(pid=26154) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26164): Process ended prematurely: osmo-stp_10.42.42.5(pid=26164) [trial-2390↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=26182): Process ended prematurely: osmo-stp_10.42.42.5(pid=26182) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26182)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26198): Process ended prematurely: osmo-stp_10.42.42.5(pid=26198) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26198)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26218): Process ended prematurely: osmo-stp_10.42.42.5(pid=26218) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26247): Process ended prematurely: osmo-stp_10.42.42.5(pid=26247) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26247)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26258): Process ended prematurely: osmo-stp_10.42.42.5(pid=26258) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26306): Process ended prematurely: osmo-stp_10.42.42.5(pid=26306) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26317): Process ended prematurely: osmo-stp_10.42.42.5(pid=26317) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26317)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26328): Process ended prematurely: osmo-stp_10.42.42.5(pid=26328) [trial-2390↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26328)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26348): Process ended prematurely: osmo-stp_10.42.42.5(pid=26348) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26348)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26360): Process ended prematurely: osmo-stp_10.42.42.5(pid=26360) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26360)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26378): Process ended prematurely: osmo-stp_10.42.42.5(pid=26378) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26378)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26388): Process ended prematurely: osmo-stp_10.42.42.5(pid=26388) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26388)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26398): Process ended prematurely: osmo-stp_10.42.42.5(pid=26398) [trial-2390↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26398)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26424): Process ended prematurely: osmo-stp_10.42.42.5(pid=26424) [trial-2390↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26424)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26432) [trial-2390↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26432)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=26445): Process ended prematurely: osmo-stp_10.42.42.5(pid=26445) [trial-2390↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26454): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26454) [trial-2390↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26454)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26464): Process ended prematurely: osmo-stp_10.42.42.5(pid=26464) [trial-2390↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26464)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26479): Process ended prematurely: osmo-stp_10.42.42.5(pid=26479) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26490): Process ended prematurely: osmo-stp_10.42.42.5(pid=26490) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26518): Process ended prematurely: osmo-stp_10.42.42.5(pid=26518) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26518)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26532): Process ended prematurely: osmo-stp_10.42.42.5(pid=26532) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26532)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26543): Process ended prematurely: osmo-stp_10.42.42.5(pid=26543) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26543)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26557): Process ended prematurely: osmo-stp_10.42.42.5(pid=26557) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26557)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26570): Process ended prematurely: osmo-stp_10.42.42.5(pid=26570) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26570)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26584): Process ended prematurely: osmo-stp_10.42.42.5(pid=26584) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26584)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26595): Process ended prematurely: osmo-stp_10.42.42.5(pid=26595) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26609): Process ended prematurely: osmo-stp_10.42.42.5(pid=26609) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26609)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26634): Process ended prematurely: osmo-stp_10.42.42.5(pid=26634) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26645): Process ended prematurely: osmo-stp_10.42.42.5(pid=26645) [trial-2390↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26645)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26659): Process ended prematurely: osmo-stp_10.42.42.5(pid=26659) [trial-2390↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26659)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2390↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26689): Process ended prematurely: osmo-stp_10.42.42.5(pid=26689) [trial-2390↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26689)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=26701): Process ended prematurely: osmo-stp_10.42.42.5(pid=26701) [trial-2390↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=26719): Process ended prematurely: osmo-stp_10.42.42.5(pid=26719) [trial-2390↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26719)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26731): Process ended prematurely: osmo-stp_10.42.42.5(pid=26731) [trial-2390↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26731)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26741): Process ended prematurely: osmo-stp_10.42.42.5(pid=26741) [trial-2390↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26759): Process ended prematurely: osmo-stp_10.42.42.5(pid=26759) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26759)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26771): Process ended prematurely: osmo-stp_10.42.42.5(pid=26771) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26771)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26789): Process ended prematurely: osmo-stp_10.42.42.5(pid=26789) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26789)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26799): Process ended prematurely: osmo-stp_10.42.42.5(pid=26799) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26809): Process ended prematurely: osmo-stp_10.42.42.5(pid=26809) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26809)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26827): Process ended prematurely: osmo-stp_10.42.42.5(pid=26827) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26839): Process ended prematurely: osmo-stp_10.42.42.5(pid=26839) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26839)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26857): Process ended prematurely: osmo-stp_10.42.42.5(pid=26857) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26881): Process ended prematurely: osmo-stp_10.42.42.5(pid=26881) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26881)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26899): Process ended prematurely: osmo-stp_10.42.42.5(pid=26899) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26899)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26911): Process ended prematurely: osmo-stp_10.42.42.5(pid=26911) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26941): Process ended prematurely: osmo-stp_10.42.42.5(pid=26941) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26941)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26951): Process ended prematurely: osmo-stp_10.42.42.5(pid=26951) [trial-2390↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26977): Process ended prematurely: osmo-stp_10.42.42.5(pid=26977) [trial-2390↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26977)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26986) [trial-2390↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26986)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26996): Process ended prematurely: osmo-stp_10.42.42.5(pid=26996) [trial-2390↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26996)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27006): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27006) [trial-2390↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27006)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27016): Process ended prematurely: osmo-stp_10.42.42.5(pid=27016) [trial-2390↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27030): Process ended prematurely: osmo-stp_10.42.42.5(pid=27030) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27030)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27041): Process ended prematurely: osmo-stp_10.42.42.5(pid=27041) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27056): Process ended prematurely: osmo-stp_10.42.42.5(pid=27056) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27056)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27067): Process ended prematurely: osmo-stp_10.42.42.5(pid=27067) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27067)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27081): Process ended prematurely: osmo-stp_10.42.42.5(pid=27081) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27081)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27097): Process ended prematurely: osmo-stp_10.42.42.5(pid=27097) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27111): Process ended prematurely: osmo-stp_10.42.42.5(pid=27111) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27111)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27195): Process ended prematurely: osmo-stp_10.42.42.5(pid=27195) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27195)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27407): Process ended prematurely: osmo-stp_10.42.42.5(pid=27407) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27407)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27419): Process ended prematurely: osmo-stp_10.42.42.5(pid=27419) [trial-2390↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27434): Process ended prematurely: osmo-stp_10.42.42.5(pid=27434) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27445): Process ended prematurely: osmo-stp_10.42.42.5(pid=27445) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27445)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27460): Process ended prematurely: osmo-stp_10.42.42.5(pid=27460) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27460)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27471): Process ended prematurely: osmo-stp_10.42.42.5(pid=27471) [trial-2390↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27488): Process ended prematurely: osmo-stp_10.42.42.5(pid=27488) [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27488)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27499): Process ended prematurely: osmo-stp_10.42.42.5(pid=27499) [trial-2390↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27499)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27513): Process ended prematurely: osmo-stp_10.42.42.5(pid=27513) [trial-2390↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27513)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27524): Process ended prematurely: osmo-stp_10.42.42.5(pid=27524) [trial-2390↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27524)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=27543): Process ended prematurely: osmo-stp_10.42.42.5(pid=27543) [trial-2390↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27543)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27555): Process ended prematurely: osmo-stp_10.42.42.5(pid=27555) [trial-2390↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27555)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=27573): Process ended prematurely: osmo-stp_10.42.42.5(pid=27573) [trial-2390↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27583): Process ended prematurely: osmo-stp_10.42.42.5(pid=27583) [trial-2390↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27583)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27593): Process ended prematurely: osmo-stp_10.42.42.5(pid=27593) [trial-2390↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27593)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=27648): Process ended prematurely: osmo-stp_10.42.42.5(pid=27648) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27648)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27658): Process ended prematurely: osmo-stp_10.42.42.5(pid=27658) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27658)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27668): Process ended prematurely: osmo-stp_10.42.42.5(pid=27668) [trial-2390↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27668)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=27685): Process ended prematurely: osmo-stp_10.42.42.5(pid=27685) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27685)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27697): Process ended prematurely: osmo-stp_10.42.42.5(pid=27697) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27697)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27715): Process ended prematurely: osmo-stp_10.42.42.5(pid=27715) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27715)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27725): Process ended prematurely: osmo-stp_10.42.42.5(pid=27725) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27725)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27735): Process ended prematurely: osmo-stp_10.42.42.5(pid=27735) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27752): Process ended prematurely: osmo-stp_10.42.42.5(pid=27752) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27752)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27764): Process ended prematurely: osmo-stp_10.42.42.5(pid=27764) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27764)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27782): Process ended prematurely: osmo-stp_10.42.42.5(pid=27782) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27782)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27793): Process ended prematurely: osmo-stp_10.42.42.5(pid=27793) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27793)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27803): Process ended prematurely: osmo-stp_10.42.42.5(pid=27803) [trial-2390↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27803)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27836): Process ended prematurely: osmo-stp_10.42.42.5(pid=27836) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27854): Process ended prematurely: osmo-stp_10.42.42.5(pid=27854) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27854)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27864): Process ended prematurely: osmo-stp_10.42.42.5(pid=27864) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27864)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27874): Process ended prematurely: osmo-stp_10.42.42.5(pid=27874) [trial-2390↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27874)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27890): Process ended prematurely: osmo-stp_10.42.42.5(pid=27890) [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27890)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27903): Process ended prematurely: osmo-stp_10.42.42.5(pid=27903) [trial-2390↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27903)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=27911): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27911) [trial-2390↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27911)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=27921): Process ended prematurely: osmo-stp_10.42.42.5(pid=27921) [trial-2390↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27921)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=27930): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27930) [trial-2390↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27930)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=27940): Process ended prematurely: osmo-stp_10.42.42.5(pid=27940) [trial-2390↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27940)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27954): Process ended prematurely: osmo-stp_10.42.42.5(pid=27954) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27965): Process ended prematurely: osmo-stp_10.42.42.5(pid=27965) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27979): Process ended prematurely: osmo-stp_10.42.42.5(pid=27979) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27990): Process ended prematurely: osmo-stp_10.42.42.5(pid=27990) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27990)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28004): Process ended prematurely: osmo-stp_10.42.42.5(pid=28004) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28004)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28015): Process ended prematurely: osmo-stp_10.42.42.5(pid=28015) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28015)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28029): Process ended prematurely: osmo-stp_10.42.42.5(pid=28029) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28029)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28040): Process ended prematurely: osmo-stp_10.42.42.5(pid=28040) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28040)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28056): Process ended prematurely: osmo-stp_10.42.42.5(pid=28056) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28067): Process ended prematurely: osmo-stp_10.42.42.5(pid=28067) [trial-2390↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28067)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28092): Process ended prematurely: osmo-stp_10.42.42.5(pid=28092) [trial-2390↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28092)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28106): Process ended prematurely: osmo-stp_10.42.42.5(pid=28106) [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28117): Process ended prematurely: osmo-stp_10.42.42.5(pid=28117) [trial-2390↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28117)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28131): Process ended prematurely: osmo-stp_10.42.42.5(pid=28131) [trial-2390↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28142): Process ended prematurely: osmo-stp_10.42.42.5(pid=28142) [trial-2390↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28142)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28161): Process ended prematurely: osmo-stp_10.42.42.5(pid=28161) [trial-2390↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28176): Process ended prematurely: osmo-stp_10.42.42.5(pid=28176) [trial-2390↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28176)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28194): Process ended prematurely: osmo-stp_10.42.42.5(pid=28194) [trial-2390↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28194)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28204): Process ended prematurely: osmo-stp_10.42.42.5(pid=28204) [trial-2390↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28204)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28214): Process ended prematurely: osmo-stp_10.42.42.5(pid=28214) [trial-2390↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28231): Process ended prematurely: osmo-stp_10.42.42.5(pid=28231) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28267): Process ended prematurely: osmo-stp_10.42.42.5(pid=28267) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28267)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28277): Process ended prematurely: osmo-stp_10.42.42.5(pid=28277) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28277)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2390↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28304): Process ended prematurely: osmo-stp_10.42.42.5(pid=28304) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28304)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28316): Process ended prematurely: osmo-stp_10.42.42.5(pid=28316) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28316)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28335): Process ended prematurely: osmo-stp_10.42.42.5(pid=28335) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28335)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28345): Process ended prematurely: osmo-stp_10.42.42.5(pid=28345) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28345)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28355): Process ended prematurely: osmo-stp_10.42.42.5(pid=28355) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28384): Process ended prematurely: osmo-stp_10.42.42.5(pid=28384) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28405): Process ended prematurely: osmo-stp_10.42.42.5(pid=28405) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28415): Process ended prematurely: osmo-stp_10.42.42.5(pid=28415) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28415)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2390↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28669): Process ended prematurely: osmo-stp_10.42.42.5(pid=28669) [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28669)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28722): Process ended prematurely: osmo-stp_10.42.42.5(pid=28722) [trial-2390↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28722)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=28730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28730) [trial-2390↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28730)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2390↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28750): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28750) [trial-2390↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28750)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28760): Process ended prematurely: osmo-stp_10.42.42.5(pid=28760) [trial-2390↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28775): Process ended prematurely: osmo-stp_10.42.42.5(pid=28775) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28775)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28786): Process ended prematurely: osmo-stp_10.42.42.5(pid=28786) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28786)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28803): Process ended prematurely: osmo-stp_10.42.42.5(pid=28803) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28803)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28814): Process ended prematurely: osmo-stp_10.42.42.5(pid=28814) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28828): Process ended prematurely: osmo-stp_10.42.42.5(pid=28828) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28839): Process ended prematurely: osmo-stp_10.42.42.5(pid=28839) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28839)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28854): Process ended prematurely: osmo-stp_10.42.42.5(pid=28854) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28854)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28868): Process ended prematurely: osmo-stp_10.42.42.5(pid=28868) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28882): Process ended prematurely: osmo-stp_10.42.42.5(pid=28882) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28882)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28893): Process ended prematurely: osmo-stp_10.42.42.5(pid=28893) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28893)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28907): Process ended prematurely: osmo-stp_10.42.42.5(pid=28907) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28907)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28918): Process ended prematurely: osmo-stp_10.42.42.5(pid=28918) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28918)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28932): Process ended prematurely: osmo-stp_10.42.42.5(pid=28932) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28932)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28943): Process ended prematurely: osmo-stp_10.42.42.5(pid=28943) [trial-2390↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28957): Process ended prematurely: osmo-stp_10.42.42.5(pid=28957) [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28957)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28968): Process ended prematurely: osmo-stp_10.42.42.5(pid=28968) [trial-2390↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28986): Process ended prematurely: osmo-stp_10.42.42.5(pid=28986) [trial-2390↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28986)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28998): Process ended prematurely: osmo-stp_10.42.42.5(pid=28998) [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=29016): Process ended prematurely: osmo-stp_10.42.42.5(pid=29016) [trial-2390↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29016)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29026): Process ended prematurely: osmo-stp_10.42.42.5(pid=29026) [trial-2390↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29026)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29036): Process ended prematurely: osmo-stp_10.42.42.5(pid=29036) [trial-2390↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29065): Process ended prematurely: osmo-stp_10.42.42.5(pid=29065) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29084): Process ended prematurely: osmo-stp_10.42.42.5(pid=29084) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29084)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29094): Process ended prematurely: osmo-stp_10.42.42.5(pid=29094) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29094)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29105): Process ended prematurely: osmo-stp_10.42.42.5(pid=29105) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29105)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29122): Process ended prematurely: osmo-stp_10.42.42.5(pid=29122) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29122)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29156): Process ended prematurely: osmo-stp_10.42.42.5(pid=29156) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29156)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29166): Process ended prematurely: osmo-stp_10.42.42.5(pid=29166) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29166)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=29176): Process ended prematurely: osmo-stp_10.42.42.5(pid=29176) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29194): Process ended prematurely: osmo-stp_10.42.42.5(pid=29194) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29194)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29229): Process ended prematurely: osmo-stp_10.42.42.5(pid=29229) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29239): Process ended prematurely: osmo-stp_10.42.42.5(pid=29239) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29239)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29249): Process ended prematurely: osmo-stp_10.42.42.5(pid=29249) [trial-2390↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29249)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29262): Process ended prematurely: osmo-stp_10.42.42.5(pid=29262) [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29262)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29275): Process ended prematurely: osmo-stp_10.42.42.5(pid=29275) [trial-2390↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29275)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29284) [trial-2390↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29284)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29295): Process ended prematurely: osmo-stp_10.42.42.5(pid=29295) [trial-2390↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29295)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29304): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29304) [trial-2390↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29304)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29314): Process ended prematurely: osmo-stp_10.42.42.5(pid=29314) [trial-2390↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29314)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29328): Process ended prematurely: osmo-stp_10.42.42.5(pid=29328) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29328)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29339): Process ended prematurely: osmo-stp_10.42.42.5(pid=29339) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29339)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29353): Process ended prematurely: osmo-stp_10.42.42.5(pid=29353) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29379): Process ended prematurely: osmo-stp_10.42.42.5(pid=29379) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29390): Process ended prematurely: osmo-stp_10.42.42.5(pid=29390) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29390)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29405): Process ended prematurely: osmo-stp_10.42.42.5(pid=29405) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29416): Process ended prematurely: osmo-stp_10.42.42.5(pid=29416) [trial-2390↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29416)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29430): Process ended prematurely: osmo-stp_10.42.42.5(pid=29430) [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29430)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2390↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29456): Process ended prematurely: osmo-stp_10.42.42.5(pid=29456) [trial-2390↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29467): Process ended prematurely: osmo-stp_10.42.42.5(pid=29467) [trial-2390↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29467)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29485): Process ended prematurely: osmo-stp_10.42.42.5(pid=29485) [trial-2390↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2390↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2390↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29528): Process ended prematurely: osmo-stp_10.42.42.5(pid=29528) [trial-2390↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29528)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29538): Process ended prematurely: osmo-stp_10.42.42.5(pid=29538) [trial-2390↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29538)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29556): Process ended prematurely: osmo-stp_10.42.42.5(pid=29556) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29556)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29568): Process ended prematurely: osmo-stp_10.42.42.5(pid=29568) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29568)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29586): Process ended prematurely: osmo-stp_10.42.42.5(pid=29586) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29586)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29596): Process ended prematurely: osmo-stp_10.42.42.5(pid=29596) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29596)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29606): Process ended prematurely: osmo-stp_10.42.42.5(pid=29606) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29624): Process ended prematurely: osmo-stp_10.42.42.5(pid=29624) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29636): Process ended prematurely: osmo-stp_10.42.42.5(pid=29636) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29636)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29654): Process ended prematurely: osmo-stp_10.42.42.5(pid=29654) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29664): Process ended prematurely: osmo-stp_10.42.42.5(pid=29664) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2390↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29687): Process ended prematurely: osmo-stp_10.42.42.5(pid=29687) [trial-2390↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29687)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29701): Process ended prematurely: osmo-stp_10.42.42.5(pid=29701) [trial-2390↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29701)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29710) [trial-2390↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29710)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29721): Process ended prematurely: osmo-stp_10.42.42.5(pid=29721) [trial-2390↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29721)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29735): Process ended prematurely: osmo-stp_10.42.42.5(pid=29735) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29735)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29746): Process ended prematurely: osmo-stp_10.42.42.5(pid=29746) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29746)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29860): Process ended prematurely: osmo-stp_10.42.42.5(pid=29860) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29860)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30043): Process ended prematurely: osmo-stp_10.42.42.5(pid=30043) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30061): Process ended prematurely: osmo-stp_10.42.42.5(pid=30061) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30099): Process ended prematurely: osmo-stp_10.42.42.5(pid=30099) [trial-2390↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30113): Process ended prematurely: osmo-stp_10.42.42.5(pid=30113) [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30113)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2390↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2390↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30168): Process ended prematurely: osmo-stp_10.42.42.5(pid=30168) [trial-2390↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30168)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30179): Process ended prematurely: osmo-stp_10.42.42.5(pid=30179) [trial-2390↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30179)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30198): Process ended prematurely: osmo-stp_10.42.42.5(pid=30198) [trial-2390↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=30210): Process ended prematurely: osmo-stp_10.42.42.5(pid=30210) [trial-2390↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30210)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=30228): Process ended prematurely: osmo-stp_10.42.42.5(pid=30228) [trial-2390↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30228)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30238): Process ended prematurely: osmo-stp_10.42.42.5(pid=30238) [trial-2390↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30238)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30248): Process ended prematurely: osmo-stp_10.42.42.5(pid=30248) [trial-2390↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30248)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30265): Process ended prematurely: osmo-stp_10.42.42.5(pid=30265) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30265)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30277): Process ended prematurely: osmo-stp_10.42.42.5(pid=30277) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30277)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30295): Process ended prematurely: osmo-stp_10.42.42.5(pid=30295) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30305): Process ended prematurely: osmo-stp_10.42.42.5(pid=30305) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30305)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30315): Process ended prematurely: osmo-stp_10.42.42.5(pid=30315) [trial-2390↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30315)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30332): Process ended prematurely: osmo-stp_10.42.42.5(pid=30332) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30332)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=30344): Process ended prematurely: osmo-stp_10.42.42.5(pid=30344) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30344)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30370): Process ended prematurely: osmo-stp_10.42.42.5(pid=30370) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30370)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30380): Process ended prematurely: osmo-stp_10.42.42.5(pid=30380) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30390): Process ended prematurely: osmo-stp_10.42.42.5(pid=30390) [trial-2390↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30407): Process ended prematurely: osmo-stp_10.42.42.5(pid=30407) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30419): Process ended prematurely: osmo-stp_10.42.42.5(pid=30419) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30419)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=30438): Process ended prematurely: osmo-stp_10.42.42.5(pid=30438) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30438)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30448): Process ended prematurely: osmo-stp_10.42.42.5(pid=30448) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30448)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30458): Process ended prematurely: osmo-stp_10.42.42.5(pid=30458) [trial-2390↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30477): Process ended prematurely: osmo-stp_10.42.42.5(pid=30477) [trial-2390↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30477)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.6 sec) Error: osmo-nitb_10.42.42.2(pid=30485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30485) [trial-2390↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30485)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=30487): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30487) [trial-2390↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30487)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=30489): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30489) [trial-2390↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30489)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=30491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30491) [trial-2390↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30491)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=30500): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30500) [trial-2390↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30500)] FAIL: esme_connect_policy_closed.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=30511): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30511) [trial-2390↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30511)] FAIL: esme_ms_sms_storeforward.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30523): Process ended prematurely: osmo-stp_10.42.42.5(pid=30523) [trial-2390↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30523)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30535): Process ended prematurely: osmo-stp_10.42.42.5(pid=30535) [trial-2390↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30535)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30549): Process ended prematurely: osmo-stp_10.42.42.5(pid=30549) [trial-2390↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30549)] FAIL: register_a5_0_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30560): Process ended prematurely: osmo-stp_10.42.42.5(pid=30560) [trial-2390↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30560)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30571): Process ended prematurely: osmo-stp_10.42.42.5(pid=30571) [trial-2390↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30571)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30582): Process ended prematurely: osmo-stp_10.42.42.5(pid=30582) [trial-2390↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30582)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=30602): Process ended prematurely: srsepc(pid=30602) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30602)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=30621): Process ended prematurely: srsepc(pid=30621) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30621)] FAIL: iperf3_dl.py (19.2 sec) Error: srsepc(pid=30637): Process ended prematurely: srsepc(pid=30637) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30637)] FAIL: iperf3_ul.py (19.1 sec) Error: srsepc(pid=30653): Process ended prematurely: srsepc(pid=30653) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30653)] FAIL: ping.py (18.2 sec) Error: srsepc(pid=30669): Process ended prematurely: srsepc(pid=30669) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30669)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=30685): Process ended prematurely: srsepc(pid=30685) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30685)] FAIL: rrc_idle_mt_ping.py (18.6 sec) Error: srsepc(pid=30701): Process ended prematurely: srsepc(pid=30701) [trial-2390↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=30701)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30714): Process ended prematurely: osmo-stp_10.42.42.5(pid=30714) [trial-2390↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30714)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2390↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30744): Process ended prematurely: osmo-stp_10.42.42.5(pid=30744) [trial-2390↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30758): Process ended prematurely: osmo-stp_10.42.42.5(pid=30758) [trial-2390↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30758)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30773): Process ended prematurely: osmo-stp_10.42.42.5(pid=30773) [trial-2390↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30787): Process ended prematurely: osmo-stp_10.42.42.5(pid=30787) [trial-2390↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30787)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30804): Process ended prematurely: osmo-stp_10.42.42.5(pid=30804) [trial-2390↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30818): Process ended prematurely: osmo-stp_10.42.42.5(pid=30818) [trial-2390↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30818)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30833): Process ended prematurely: osmo-stp_10.42.42.5(pid=30833) [trial-2390↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30833)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30848): Process ended prematurely: osmo-stp_10.42.42.5(pid=30848) [trial-2390↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2390↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30877): Process ended prematurely: osmo-stp_10.42.42.5(pid=30877) [trial-2390↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30877)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30891): Process ended prematurely: osmo-stp_10.42.42.5(pid=30891) [trial-2390↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30891)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30905): Process ended prematurely: osmo-stp_10.42.42.5(pid=30905) [trial-2390↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30905)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30919): Process ended prematurely: osmo-stp_10.42.42.5(pid=30919) [trial-2390↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30919)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30933): Process ended prematurely: osmo-stp_10.42.42.5(pid=30933) [trial-2390↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30933)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30947): Process ended prematurely: osmo-stp_10.42.42.5(pid=30947) [trial-2390↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30961): Process ended prematurely: osmo-stp_10.42.42.5(pid=30961) [trial-2390↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30975): Process ended prematurely: osmo-stp_10.42.42.5(pid=30975) [trial-2390↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30975)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30989): Process ended prematurely: osmo-stp_10.42.42.5(pid=30989) [trial-2390↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31003): Process ended prematurely: osmo-stp_10.42.42.5(pid=31003) [trial-2390↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31003)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31017): Process ended prematurely: osmo-stp_10.42.42.5(pid=31017) [trial-2390↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31017)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31031): Process ended prematurely: osmo-stp_10.42.42.5(pid=31031) [trial-2390↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31045): Process ended prematurely: osmo-stp_10.42.42.5(pid=31045) [trial-2390↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31045)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31059): Process ended prematurely: osmo-stp_10.42.42.5(pid=31059) [trial-2390↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31345): Process ended prematurely: osmo-stp_10.42.42.5(pid=31345) [trial-2390↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31345)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=31359): Process ended prematurely: osmo-stp_10.42.42.5(pid=31359) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31359)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31373): Process ended prematurely: osmo-stp_10.42.42.5(pid=31373) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31387): Process ended prematurely: osmo-stp_10.42.42.5(pid=31387) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31402): Process ended prematurely: osmo-stp_10.42.42.5(pid=31402) [trial-2390↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31402)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31417): Process ended prematurely: osmo-stp_10.42.42.5(pid=31417) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31417)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31434): Process ended prematurely: osmo-stp_10.42.42.5(pid=31434) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31434)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31448): Process ended prematurely: osmo-stp_10.42.42.5(pid=31448) [trial-2390↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31448)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2390↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2390↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31493): Process ended prematurely: osmo-stp_10.42.42.5(pid=31493) [trial-2390↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31493)] + rm -rf trial-2390/inst + cd trial-2390 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 13:00:57 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390-run.tgz run.2022-12-13_13-01-08 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2390-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9255.tgz osmo-trx.build-4682.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE